If the job doens't require it and you're not comfortable doing it, then don't do the chatting!
Make friends there sure, but don't be forced to do stuff you don't want if it's not part of the job.
I'm similar in outlook to you, I go to work to actually work not talk and joke around, that can be done at break times and leisure times.
Good luck, hang in there, jobs are precious at the moment!

Injustice will be avenged.
Cofiwch Dryweryn.