Yes, "Time" is track length, there are many ways, fastest may be to make an auto-playlist:
Near your existing playlists Rclick > New > New Auto-Playlist.
Name it "Empty Files" or something, Display Using View: Track Details,
Music Track Source [yes] Music Library,
Match All,
Time | Is Less Than | 0:10,
[ no] filter,
[ no] limit,
[yes] automatically refresh the matching tracks,
[ no] export.
Save.
This will list out tracks less than 10 seconds long, you can highlight and delete what you want, or change that value to just 0:00 if you want.