Many file formats are not supported by stock Android player, like playing iPhone .mov, .mkv files. It seems to be a codec issue. However, third party enhanced video player apps from Google app store resolve the problem.
Best Video player apps for nexus 4
* MX Player
One of the best video player. It supports multi-core core processing, so HD movies play without any lag. Easy to forward/rewind and zoom in/out. With new update, it is good but has few issues. Some h/w mode formats are not allowed to fast forward.
* VPlayer 3.x
Supported file formats include 720p MKV, AVI, MOV, FLV, TS, M4V and 3GP, even 1080p. You are able to play streamed videos like YouTube, Facebook and Dropbox.
It is compatibile with Android 4.2 Jelly Bean MR1 and supports for almost all media files and samba share stream. Playing 720p videos without skipping but no Rock chip support.