Don't remove brew on travis

I noticed that cache is not saved if brew is removed
(apparently some travis tool requires a brew library)