Why is it so expensive?? I bought 1 liter bottles for less than $12 before.

I confirm as of 8-15-2019 that Starbucks sells the 1 liter bottle for 13 bucks right now. don't waste your cash on this over priced syrup.

does the carmel syrup come with a pump

You get a pump with every bottle. Here is a hint. If you try to put the pump in a brand new (completely full) bottle the syrup splooges out of the bottle. Use a little from the bottle before putting in the new pump and save yourself some clean-up.

Does this need to be refrigerated?

I know this is an old question, but these are the same bottles used in Starbucks stores. When I was a barista, we did not refrigerate the bottles at the end of the day. Open bottles have a shelf-life of about 30 days.