Sesame Street Birthday Party Ideas
BY A PROFESSIONAL PARTY PLANNER
Ideas include:
Sesame Street birthday party invitations
Sesame Street birthday party food
Sesame Street birthday party drinks
Sesame Street birthday party decorations
Sesame Street dessert table ideas
Sesame Street dessert table ideas
Sesame Street birthday cake ideas
Sesame Street birthday party games
affiliate disclaimer
This post contains affiliate links so I may earn a small commission on any products purchases at no extra cost to you.
i’m matt james
professional event producer
welcome
in this section
01 SESAME STREET PARTY INVITATIONS
Below are some suggestions for invitations to go with these Sesame Street birthday party ideas:
ADVICE FROM A PRO
Matt’s tip
“I think it’s important to create a big first impression, which is why I always try to include some sort of 3D object tied to the printed invitation with ribbon.
This is a little trick that’s often used by professional party planners to make invitations stand out.
It doesn’t have to be anything expensive, just some cheap novelties, and you can use it re-enforce your party theme. For example, kids sunglasses or a flip flop for a beach party, a toy dinosaur for a dinosaur party, or an eye patch for a pirate party.
People just love to receive unusual invitations; it really captures their imagination and gets them excited about the party.
Click here to check out some examples of 3D object invitations from my party invitations page (opens in a new tab)”.
the idea
3D SESAME STREET PARTY INVITATIONS
Edible party invitations always grab people’s attention and you can pick up these cookies, available here, or lollipop, available here, for a couple of dollars each to use them as the invitations for your Sesame Street birthday party.
Wrap each cookie in a cellophane bag tied up with ribbon and send them out in these cute box mailers along with these VIP ‘All Access’ pass style Sesame Street invitations or these printable ones, available here.
the idea
SHAPED SESAME STREET PARTY INVITATIONS
I particularly like these die cut style invitations, available here, which would be good for a Sesame Street birthday party or baby shower. Each character looks cute poking out of the little envelopes, which come with a seal sticker relevant to each character, i.e. a cookie for Cookie Monster or Dorothy’s Goldfish bowl for Elmo.
the idea
TRADITIONAL SESAME STREET PARTY INVITATIONS
Alternatively, there are lots of other personalized Sesame Street birthday party invitations to choose from, available here and also here.
I particularly like invitations in the shape of the Sesame Street sign, but they also have plenty of others where you can include a photo of the birthday boy or girl.
the idea
SESAME STREET INVITATION WORDING
If you’re making your own Sesame Street birthday party invitations, here are some ideas for the wording:
in this section
02 Sesame street party drinks
Read on for details on how to make delicious Ducky Bath Punch, Mini Cookie Milkshake, Big Bird’s seed milkshake and much more:
ADVICE FROM A PRO
Matt’s tip
“Always create a signature drink for your party—it’s one of the easiest things you can do to make your party unique.
If your party has a theme, think about what flavors you can use in your signature drink that will convey it.
Don’t forget about styling and presentation too. You could serve drinks in individual bottles, jars, or novelty containers, add your own labels, use themed ice cubes, decorative straws, or drinks picks, or add a simple garnish.
A sprig of berries or a single flower head on the rim of a glass can make a simple cocktail look really stylish”.
the idea
ERNIE’S RUBBER DUCKY PUNCH
This recipe for Ducky Bath Punch (below left, by Cheryl at The Tidy Mom) was originally created for a baby shower, but I think it’s perfect to be re-named as Ernie’s Rubber Ducky Punch for a Sesame Street birthday party.
You can pick up mini sized rubber ducks, available here. They have every type of themed rubber duck you can think of from baby boy ducks (below) and St Patrick’s ducks, to Zombie and Rock Star ducks.
the idea
COOKIE MONSTER MILKSHAKE
This Mini Cookie Milkshake (from We Are Not Martha) would make a perfect Cookie Monster themed party drink. Serve them in milk bottles, as shown in the picture below by Sweetly Chic via Evite, you can pick them up here.
There’s also this cute Cookie Monster smoothie.
the idea
OSCAR’S TRASH CAN PUNCH
Make this Wormy Swamp Punch but freeze the worms into the OJ ice cubes so they float on top like bits of trash. Use fish bone ice cube molds, available here, too and bits of fruit—anything that might add to the trash can look.
Sit your punch bowl raised up on a cake stand, then create a façade by wrapping them both in some thick card arranged in a cylindrical shape. Cover the card with tin foil to look like Oscar’s trash can, and scrunch up some balls of news paper around it. Serve the punch in silver party cups, available here, to resemble mini trash cans.
Note: I would have suggested using small metal pails as trash cans, but note that most of these are not food safe, and the ones that are tend to be too big to use as cups.
the idea
BIG BIRD’S BIRD SEED MILKSHAKES
Everyone knows Big Bird loves his bird seed milkshakes, but how do you make one that’s actually edible?
I came across a posting from ‘Bear’ on the Muppet Central fan site who’s come up with a simple recipe. He used shelled sunflower and pumpkin seeds in a blender with some milk, a couple of scoops of vanilla ice cream, and some cinnamon.
Alternatively, you could use this banana almond smoothie recipe, below from Cookie and Kate, and just garnish with seeds.
don’t miss a thing
follow me on social
Keep up with my latest ideas by following me on social media
the idea
BIG BIRD PUNCH
Make a simple pineapple punch and call it Big Bird Punch. Serve it in these Sesame Street party cups, available here, (or sippers for younger kids).
Alternatively, serve it in a punch bowl and then follow the steps below to turn the bowl into big bird’s face:
For the base: Cut the top, bottom and sides off a pineapple so you’re left with a large block of pineapple that will stand up in your punch bowl.
For the eyes: Stick two skewers into the top of the pineapple, so the top of the skewers stand an inch or so below the rim of your punch bowl. Then add a slice of apple (dipped in lemon juice to stop it browning) to the top of each skewer with a black grape in the middle of each. Cut 2 semi circles of orange fruit leather (or orange peel) and put these on top of the apple slice as eyelids.
For the beak: Peel a banana and cut a bit off one end to create a flat base. Cover in a little lemon juice. Then, using a skewer fix the banana into the pineapple base so that the top of the banana is more or less the same height as the apple eyes. Repeat with another banana for the bottom part of the beak. You can also line the inside of each banana with some red fruit leather to create the inside of his mouth.
For the face: Then fill the bowl with the pineapple punch (covering the pineapple base) up to the bottom of the apple eyes / banana beak, and wrap a couple of yellow feather boas around the bowl to create Bird Bird’s feathers.
the idea
SESAME STREET JUICE BOXES / SMOOTHIES
For a quick fix, you can pick up these Sesame Street organic juice boxes, available here, and smoothie packs, available here.
the idea
SESAME STREET WATER LABELS
Give regular water bottles a Sesame Street makeover with these printable labels, available here.
the idea
DRINKS STYLING
Style your drinks with these Sesame Street ice cube molds, available here, which you can also use to create chocolate or jello treats in the shape of Elmo or Cookie Monster’s face. There are also lots of cute Sesame Street straws and printable straw flags, available here.
I particularly like these ones with the faces of all the characters, available here. They’d look great for drinks served in glass milk bottles.
in this section
03 sesame street party food
Below are some food suggestions to go with these Sesame Street party ideas.
ADVICE FROM A PRO
disclaimer
“As a professional party planner, I’m lucky enough to be able to collaborate with some amazing chefs to create menus for my events.
As I’m no chef myself, and cannot create dishes from scratch, I’ve searched the web for recipes that I think would work well for this party theme.
All credit goes to the talented people who have created these recipes, so please click through to their site for full details, ingredients, methods, and in some cases step-by-step tutorials”.
the idea
SESAME STREET FRUIT PLATTERS
Check out these amazing Sesame Street faces made from fruit and vegetables (below left, by Lauren J at Catch My Party and below right, from The Produce Mum) – it’s such a great idea and a good way to add some healthy options to the menu. All the eyes are made from small cups of vegetable dip or vanilla pudding mix with whipped cream for the fruit ones.
There are also these great vegetable and cheese versions from A Kailo Chic Life for inspiration. I love the Big Bird cheese and crackers, so clever.
the idea
OSCAR’S TRASH CAN PUDDING CUPS
These Dirt Pudding Cups from Mel’s Kitchen could be used to create Oscar’s Trash Can Pudding Cups. Serve them in silver party cups, available here, to resemble the trash can, then top each one with one of these Oscar cake pops, available here, a fondant Oscar cupcake topper, available here, or just a regular Oscar cupcake topper, available here.
the idea
ELMO / ERNIE JELLO CUPS
These Elmo Jello Cups from Catch My Party are a quick and easy dessert. Just cut out the faces from cardstock and stick onto plastic dessert cups, available here.
Alternatively, this version of Ernie’s Rubber Ducky Punch from 11 Cupcakes (which is actually blue Gatorade and marshmallows) got me thinking that you could also make this with blue jello and serve it as a pudding cup instead of a drink. See here for the mini sized ducks.
the idea
DOROTHY’S FISH STICKS / BIG BIRD’S WORMS
11 Cupcakes also has some other cute Sesame Street birthday party food ideas, such as Dorothy’s Fish Sticks and Big Bird’s (pasta) worms.
the idea
BIG BIRD EGGS / NESTS
Sticking with Big Bird, check out these Big Bird Devilled Eggs from My Gr8 Life, or these Bird’s Nest Cookies from Art of Dessert.
the idea
ABBY’S WANDS / ELMO’S GOLDFISH
These chocolate covered Pretzels with pink and purple sprinkles make great Abby Caddaby wands (below left, from Melly Moments) or for more substantial wands, check out these, below center, from Writing Out Story. I also like the way Melly has presented goldfish crackers as Elmo’s Goldfish—such a simple renaming idea.
the idea
BROUGHT TO YOU BY THE LETTER….
A Sesame Street birthday party wouldn’t be complete without some letters, so include some alphabet spaghetti or alphabet chicken nuggets, or use alphabet cookie cutters, available here, to shape sandwiches, pizza, fruit slices, jello, or cheese into bite-sized portions. You can also use them to create personalized fruit kabobs.
the idea
AND THE NUMBER…
Similarly, use some number cookie cutters to shape food items too. Here’s a great example of using the cookie cutters on cheese slices from Libby’s Little Addiction. Alternatively, you could just pick up some number shaped cookies and call them The Count’s Numbers, like this example also from 11 Cupcakes.
the idea
SESAME STREET CRACKERS
For a quick fix you can pick up these organic Sesame Street cheddar crackers, available here, shaped like Elmo and Big Bird’s faces to serve with these cheese letters, or there are also these Letter of the Day vanilla cookies and honey sticks, available here.
the idea
BERT AND ERNIE SNACKS
I came across this picture of Bert (below left, from Mom’s Crazy Kitchen) made for a bento box. I’m not sure what she used to make this but it got me thinking that it would be fairly easy to make something similar out of cheese (which could then be served on crackers).
Use Nori to create the hair and eyebrows (or carve from the skin of a cucumber to make it more kid friendly), mozzarella and black olives (or black grapes) for the eyes, and some pepperoni for his (open) mouth.
Or for something healthier make Bert and Ernie out of fruit (below right, by Jill at Kitchen Fun with My 3 Sons):
the idea
ELMO PIZZA
Everyone knows Elmo’s favourite food is pizza, so make up some individual Elmo face pizzas, like this one (below left, by Renee Waters Photography on Flickr) using vegetables to create the features. Or check out these mini ones by Sarena Wellman with eyes and nose cut from cheese and black beans for the pupils.
related post
elmo party ideas
Don’t forget to check out my separate page of Elmo birthday party ideas, so you can incorporate some Elmo ideas into your Sesame Street birthday party. Hit the ‘Read More’ button below.
the idea
BIRD BIG MAC & CHEESE
I love this Sesame Street bento box (below left by Texas Mom of 4), particularly the way she created a Big Bird Mac & Cheese. You could serve these as individual portions in pastry cups. I’ve also included a couple of others for inspiration, below center by Mommy Kiki Can and below right by More Than I Can Chew.
the idea
OSCAR SANDWICHES / SALAD
This Oscar the Grouch bento lunch (below left, by Lise at Veggie Bento) is really cute and you can easily adapt these to make simple open sandwiches. She used the Elmo cookie cutter, available here, to cut out a bread base then topped it with mashed avocado.
You can make eyes by cutting out small circles of mozzarella then adding black olives as the pupils. Or just use the cookie cutter to shape regular sandwiches.
I also came across this great Oscar lunch box salad from Family Fresh Meals, which is a great way to get kids to eat some greens.
the idea
“C” IS FOR COOKIE
This No Churn Cookie Monster Ice Cream is really cool, but could look even better presented as Individual Cookie Monster Ice Cream Cones like these from Hungry Happenings. Or try making either these Cookie Monster Cookies (below right, by Katrina of In Katrina’s Kitchen)
the idea
SESAME STREET COOKIES
You can pick up lots of great Sesame Street cookie cutters, available here, to make your own cookies. Alternatively, if you’re not one for baking, they also have plenty of baked to order cookies, such as the ones below, available here (although many more designs available).
the idea
SESAME STREET OREOS / RICE KRISPIES
These Sesame Street Rice Krispie Treats from Two Sisters Crafting are easy enough to make. Alternatively, you can buy Sesame Street Oreos, such as these Big Bird Oreos, available here (other characters available).
the idea
SESAME STREET CAKE POPS
Follow this tutorial to make Sesame Street cake pops (below left, by Bakerella), or you can just buy something similar, available here, (other characters available).
the idea
SESAME STREET CUPCAKES
To make other Sesame Street cupcakes such as Big Bird, Oscar, or Elmo you can pipe the frosting (like these below left, by Charmaine at Charmaine’s Pastry Blog). You can then buy these cupcake topper kits, available here, which provide the fondant facial features for you to add to your own cupcakes.
the idea
SESAME STREET CUPCAKE TOPPERS
Alternatively, there are also a number of different Sesame Street cupcake toppers, including edible fondant ones and personalized Sesame Street signs. Check out all the options here.
the idea
SESAME STREET CANDY WRAPPERS
You can also pick up Sesame Street candy wrapper, some of which are printable, which you can use to cover standard candy bars, make them personalized, or use as party favors. Check out all the options here.
in this section
04 SESAME STREET BIRTHDAY CAKE
Whether you’re making a birthday cake from scratch or just decorating it, below are some suggestions to go with these Sesame Street birthday party ideas:
the idea
SESAME STREET CAKE PANS
These cake pans, available here, (other characters available) are a really easy way to turn out an impressive looking Sesame Street birthday party cake. Think about how you’re going to present the cake too. For example, for an Elmo cake you could serve it on a tray with lots of crayons scattered around it.
For Oscar you could surround with crushed Oreo dirt, gummy worms, and scrunched up old newspapers. Or for The Count you could surround it with chocolate / cookie / jello numbers.
the idea
SESAME STREET EDIBLE CAKE IMAGES
If you’re not really a baker you can also get personalized edible icing cake toppers, such as the ones below, available here.
the idea
SESAME STREET CAKE TOPPERS
For something a bit more special, check out the range of Sesame Street birthday cake fondant toppers, available here.
Alternatively, check out the range of non-edible toppers, some of which can be personalized, available here.
in this section
05 dessert table styling
Below are some ideas for ways to style and decorate a Sesame Street birthday party:
ADVICE FROM A PRO
Matt’s tip
“I always think it’s a good idea to concentrate the majority of your decorations around a buffet / dessert table as this will create a focal point in the room.
Party decorations often have to compete with existing room decor, so they can get a bit lost if spread too thinly. I think you’re far better off creating one really well themed feature wall that everyone’s eye will be drawn to.
You can then use a few general decorations around the rest of the room to tie everything together.”
the idea
SESAME STREET DESSERT TABLE
When I remember Sesame Street I always think of the urban street scene with the famous lamp post and street sign, the front stoop of the brownstone apartment building, Hooper’s Store, Oscar’s trash can, and Big Bird’s nest. So take this as inspiration for your Sesame Street birthday party decorations and create this scene below for your dessert / buffet table.
the idea
BRICK WALL BACKDROP
Pick up a brick wall scene setter (below left, available here) to use as a backdrop to the food table, or for a less plastic look, pick up a roll of brick background paper, available here.
Don’t worry if this sounds a bit industrial for a kid’s party – once you add in the characters, the street sign, and some colorful balloons it will soften the look. Alternatively, if you’d prefer something a bit softer, check out the dessert table styling options on the Elmo birthday party ideas page which uses ‘Sunny Days’ theme with a blue sky background with added clouds and grass as the backdrop.
Alternatively, there’s also this Sesame Street scene setter that you could use, available here.
the idea
INSPIRATION
If you’re using the brick wall backdrop, start to build up the street scene by taking inspiration from the photo below of the Strong Museum of Play Sesame Street exhibit. Using card stock, cut out some shapes to resemble open windows (with a window ledge, etc) and add these to the brick wall backdrop.
Then add some cut outs / airwalker balloons (see below) of some of the Sesame Street characters such as Bert and Ernie, Cookie Monster, or Elmo so they look like they’re popping their head out of the window (like Big Bird in the photos below).
You can use the special Paint and Color game on the Sesame Street website to print off drawings of Sesame Street characters (below center). Just save them to your computer, enlarge them and print off yourself.
I also think the clothesline, complete with laundry, in the picture below is a really nice touch. You could make this part of your backdrop (which would help add some nice 3D elements) by stringing a line of cute baby / toddler clothes across the top of the brick wall backdrop.
You could also cut the famous green doors of 123 Sesame Street out of card stock and add these to the backdrop too.
the idea
PERSONALIZED SESAME STREET BACKDROPS
Another option is to buy one of these personalized Sesame Street backdrops, available here and also here.
the idea
SESAME STREET LAMP POST
Next, make the famous Sesame Street lamp post out of green cardstock and add this to the brick / sky backdrop. There’s a fairly hi resolution image of the Sesame Street sign here. Alternatively, this seller, has lots of smaller signs, like the ones shown below, which can be personalized.
the idea
SESAME STREET CENTERPIECE / DECAL
Alternatively, there are also a number of centerpieces in the style of the Sesame Street lamp post, available here, or you could use this wall decal, available here.
the idea
SESAME STREET CUT OUTS
This seller has a range of Sesame Street character cut outs that are approx 3ft tall. These would be a great way to decorate your street scene.
the idea
SESAME STREET AIRWALKER BALLOONS
Alternatively, you can also bring your Sesame Street birthday party to life by using these giant Airwalker balloons. You could even position the Elmo one on the dessert table (if you have enough space overhead) to use it as a dramatic centerpiece. There’s also a large Cookie Monster balloon you could use, although this one isn’t an airwalker. Check out all the options here.
At the other end of the table set up a metal waste paper basket (or cover a regular one in tin foil) and position an Oscar cut out (from the Paint and Color game mentioned previously) peering out with a cardstock speech bubble that says ‘scram!’.
the idea
SESAME STREET WALL DECALS
Another way to decorate with Sesame Street characters is to use these wall decals, available here, some of which are re-usable so you can reapply them to the birthday boy or girl’s bedroom wall after the party.
the idea
PERSONALIZED SESAME STREET BANNERS
Complete the scene by hanging a personalized Sesame Street banner over the dessert table, or you could even use this as the backdrop to your dessert table display. Check out all the options here and also here.
the idea
MORE BANNERS
This supplier also has some alternative designs, such as the ones below (more designs available).
the idea
SERVING PLATES
Use a green colored table cloth for your Sesame Street birthday party, in keeping with the green and yellow Sesame Street colors. Raise up food items at the back of the table by covering boxes with yellow paper and adding a green strip of ribbon (see illustration above). Then use yellow and white colored serving plates , in keeping with the Sesame Street colors.
Or if you prefer, use a random combination of primary colored plates to add plenty of color to the display. I recommend these disposable premium plastic plates, available here, they’re great value and look so much nicer than paper party plates.
Finish by scattering foam letters and numbers, available here, around the tabletop.
the idea
SESAME STREET DESSERT TABLE 2
Below is alternative dessert table for a Sesame Street birthday party.
the idea
STREAMER BACKDROP
If you prefer a more colorful backdrop for your dessert table, a really cheap and easy solution is to use crepe paper streamers, available here. Just twist and hang them in tight vertical lines from floor to ceiling.
the idea
SESAME STREET DESSERT TABLE 3
Finally, here is a third option for a Sesame Street themed dessert table.
the idea
BALLOON BACKDROP
Create a ‘wall’ of balloons to act as a backdrop by fixing them to vertical strips of this adhesive balloon decorating tape, available here.
in this section
06 food styling & presentation
Below are some food styling and presentation tips to go with these Sesame Street birthday party ideas.
the idea
SESAME STREET FOOD TENTS
Use these Sesame Street food tents, available here, to identify different dishes on your buffet / dessert table. There are lots of different designs available that can be customized with your own text and many are instant download printables.
the idea
SESAME STREET CUT OUTS / LABELS
These Elmo cardstock cutouts, available here, and Cookie Monster cut outs, available here, can also be attached to food containers and treats to make them look more special.
the idea
MINI PRINGLES LABELS
These printable mini Pringles labels, available here, are a great way to customize shop-bought snacks, or use them as party favors.
in this section
07 table styling
Below are some suggestions for how to style and decorate the dining table in keeping with these Sesame Street birthday party ideas:
ADVICE FROM A PRO
Matt’s tip
“If it’s a kid’s party, don’t feel as if you have to shy away from using movie / cartoon character-branded tableware.
I see a lot of kid’s parties that are so immaculately styled they look more like adult parties. It’s obvious the parents have designed it for themselves, rather than their child.
If there’s one thing I’ve learned as a professional party planner it’s to design the party for your audience, not yourself.
The reality is kids want their favorite characters to have a strong presence at their party; they don’t see this as too commercial, for them it’s just fun.
Obviously, it’s important to get the balance right, so don’t go overboard. Character plates and cups work well if combined with a solid color table cover and napkins”.
the idea
SESAME STREET PARTY PLATES
For a quick and easy way to dress the table, there are lots of great Sesame Street birthday party plates and cups available here, including some specifically for 1st birthdays.
the idea
PERSONALIZED SESAME STREET PLATES
Check out this supplier for a range of less commercial Sesame Street party plates, cups, and napkins, including many that can be personalized.
the idea
SESAME STREET CHARACTER PLATES
Alternatively, this supplier has some cute Sesame Street character plates and matching cups.
the idea
COOKIE MONSTER TABLE STYLING
Another fun idea is to theme the table around one Sesame Street character, such as Cookie Monster, Big Bird, Oscar or Elmo. The easiest way to do this is to use a solid color table cover in keeping with the character – such as blue for cookie monster.
Then create a faux fur table runner down the center of the table, using this colored fur (below center for Cookie Monster). Or if budget permits, cover the entire tabletop using faux fur.
Then choose solid color plates and napkins according to whatever secondary colors are associated with the particular character (ex, Cookie Monster would be white plates and black napkins, Big Bird would be orange plates and red napkins, Oscar would be brown plates and black napkins, and Elmo would be orange plates and black napkins).
Finally, use a plush toy of the character as a centerpiece (below right), raised up on a colored box.
the idea
ELMO TABLE STYLING
Likewise, you do apply the same approach to Elmo, or any of the other Sesame Street characters.
the idea
SESAME STREET CUTLERY
Finishing the table styling with these color coordinatized cutlery sets and napkin ties, available here.
the idea
HIGH CHAIR DECORATIONS
For younger children, there some cute high chair decorating kits, available here.
the idea
TABLE DECORATIONS
Once you’ve chosen your colors for your Sesame Street birthday party, create a tablescape running down the center that uses lots of brightly colored objects and toys that start with the same letter as your child’s first name (ex, if you child’s name starts with G use goldfish, grapefruit, gingerbread men, gorilla, etc).
You could use this as an educational game by deliberately including some more obscure objects and seeing if they can identify what they are (ex, Grapefruit—then have them taste a slice).
If you want to take this idea one step further you could also group each object according to the number of your child’s age (ex, 3 grapefruits, 3 gingerbread men, etc) and have them count them like The Count (ie, ‘One Grapefruit, ah ha ha’, ‘two grapefruits, ah ha ha’ etc).
the idea
sESAME STREET CENTERPIECE
These personalized Sesame Street letters, available here, would make a great centerpiece running down the middle of the table, and can be re-used on a bedroom wall or door after the party.
the idea
SESAME STREET CENTERPIECES
Alternatively, check out all the other cute Sesame Street centerpieces, such as the ones below, available here.
the idea
SESAME STREET PARTY HATS / TREAT HOLDERS
Finish your table styling by placing one of these Sesame Street party hats, available here, at each place, or one of these treat holders, available here, filled with small party favors.
the idea
SESAME STREET PAPER LANTERNS
I always like to have some decorations overhead too, to fill the empty space above the table, so use a cluster of paper lanterns, such as the red ones below by Martha Stewart, and add eyes and faces of the various Sesame Street characters using cardstock.
Check out budget-friendly lanterns here, or regular lanterns here, or more decorative lanterns here.
You can also pick up cheap battery mini LED lights here to pop inside and make the lanterns glow without having to worry about power cords.
Alternatively, you can buy Sesame Street themed paper lanterns, such as these below, available here.
