Core I3 2100 vs E6750 - Should I upgrade?

You'd have to get a new motherboard (i3's are LGA 1155/1156) and new RAM as well (DDR3 only). So this may cost more than you think. I wouldn't do it if you're low on money, I would hold off until you can afford a more meaningful upgrade.