Make converted mp4 to avi file play on dvd player?

I have several mp4 files which I wanted to watch on my DVD player that I had converted using a Xilisoft converter I bought recently, I try to convert them to formats which my DVD player can read then burn them to my DVD-RW but none seem to work, it's just audio and no picture. While playing on the DVD player, the formats I've tried that the formats that work on DVD players are xvid, divx, vob video file formats. Is there a way to make it play while on DVD-RW, a software perhaps? I don't want my laptop hooked to my TV using a vga cable.