Interestingly enough, this was a trend in filmmaking around the same time as the video games
@Zyffyr mentioned. The problem is that it just confuses people. "Realist" cinema sounds like a good idea but in practice it's just in contradiction with the entire purpose and strength of storytelling, i.e. to focus in on a small piece of human existence. Most realist / maximalist cinema is either boring or pretentious, or both. It's the same with video games, even something as broad as an RPG has to eliminate most of the tedium and redundancy in human life otherwise it just becomes bloated and disorganised.
If you wanted to make a game about note-taking or memory you would have to focus all the mechanics on that to justify it. I think this is part of what people mean when they react negatively to realism in games. Gameplay works best when it's focussed on one thing, and the more little details and dead-end, detached mechanics you add the less focus there is.