Sorting network share directly vs. in a library - why so slow?

[Soukyuu]

I have a network share added to the search index on both PCs and the filetype extensions are also set to be cached. I sort the folder by date, descending.

When accessing the folder directly, the sorting works as expected, the files modified last are instantly showing up at the top. However, accessing the same folder via the library interface shows the files alphabetically sorted, and you can watch the sorting gradually change to what it's supposed to be.

Any idea how to solve that?

Attempting to get rid off the libraries opens other usability issues.