The banana pepper is a medium-sized member of the chili pepper family that has a mild, tangy taste. While typically bright yellow, it is possible for them to change to green, red, or orange as they ripen. It is often pickled, stuffed or used as a raw ingredient in foods.