Line a baking sheet with wax paper or parchment paper.
Cut each bananas in half. Insert a stick or straw into the cut end of each banana. *Be careful not to break the banana.
Add avocado, honey, milk, and cocoa powder to a blender. Blend until smooth and combined.
Pour chocolate avocado mixture onto a large plate. Carefully dip each banana in the dip, coating each side of the banana completely. Lay flat on the wax paper or parchment paper.
After all bananas are dipped, sprinkle with sprinkles or other toppings (optional).
Place baking sheet in the freezer for at least 3 hours or until chocolate and bananas are frozen solid.
Remove from freezer and enjoy!