You can't play backwards in time in games! Except those rewind games.Braid.
But besides that, just because you only go one direction in time, doesn't mean that it's not happening!
Otherwise you could almost make an argument that the original super Mario Bros is only like 1.5d because you cant move backwards.