It's part of the area's history and history of your house. I don't think I would destroy it. If you can determine who built the house and whether they were important members of the community, it might improve the value of the house later on down the road.
Grape press. Lots of Italian families, or families of Italian descent, still make their own wine around here. My part of Connecticut still has a pile of Italian (ethnically) families.