Sideways / Sidewards

So i have been told off about my use of sidewards....

to me... if you use towards, forewards, backwards

then... we should use sidewards

But!!!!!

i have been told off... because in english apparently their is no continuity / syncronicity in the words we use.

Apparently it is 

Sideways

now that seems silly to me...

Sir Almo