I have been in my present job thirty-two years. I started my job when I was 18 or 19. There was a coworker who bullied me for over ten years! One time he grabbed me by neck and by my trousers and threw me nearly head first into a van ,where we were loading food. I felt very upset at the time but didn’t show it. The co-worker retired many years ago. Is that classed as an assault?
Whatever the reason for your coworker’s actions, it sounds as though he was older than you, which would have made his actions seem even more threatening, since you probably had been on the job less time.