This might not be considered a bug, but I believe it should.

Currently, the 404 pages operate such that, the current request is redirected to the 404 page.

In actual fact, this is incorrect. The page content should rather be replaced with the 404 message and the headers changed to reflect this status.

There should be no redirect, instead, the current url should be maintained.