Now, if you're thinking about setting your hummingbird water fountain next to marigolds, lilacs, or Lily of the Valley, think again. While these flowers can be showy, hummingbirds aren't fans of them.