Horsham local Mark Faulkner was in The Sussex Produce Company store in Steyning High Street with his wife Emmy and sister, Honor Young, when they spotted the star doing some 'low key' shopping.
Mark said Tom was happy to pose for a quick photograph, but was understandably keen to keep a low profile given his level of fame.
The pair were excited to get a picture with the Hollywood hunk, he said, adding 'which woman wouldn't be?'
Sussex Produce Company's owner Nick Hempleman said it was the first time his wife had shown an interest in hearing about what had happened at work.
"He was a very nice man," he said.
"He sat quietly in the corner with his wife and friends, did a bit of shopping. We tend to just leave famous people alone, I think everyone is entitled to a meal in peace and all of our staff were respectful.
"It's really lovely to see very rich, famous people using small, independent places. When you're that level of celebrity I'm sure it can be a bit of a pain in the neck, but good on him.
"He seemed like a nice, ordinary bloke."
The star of films such as Mad Max, The Dark Knight Rises and Inception was reported to have moved to the countryside from London last year with his wife, actress Charlotte Riley, after Tom was targeted by a female stalker.
The Steyning Produce Company started life as a greengrocer in 2007 and has expanded to sell a broad range of local produce from its Steyning and Worthing stores.