Yes, it is a bulb. I had the same problem when I bought my car. You have to take the gauge cluster out. There are two screws to remove. then lower your steering wheel to the lowest position. There ar colored pin conectors on the back. They have a catch that you have to push up on then pull out the connector. The bulbs are on the back of the cluster and just twist in place. You need to get the bulbs from the dealer.
The cluster is a little difficult to remove so be patient and you can do it.