Had this problem too, putting this up because it's one of the first results when googling the issue.
For me, putting Texture Quality from High to Medium worked. I may just be blind, but the option only seems to appear from the main menu, and not in-game.
Edit: After this, I put my Texture QUality back to high, switched my DLSS wizard "frames-outta-nowhere" to Balanced instead of Quality, and dropped a couple of graphic settings from Ultra to Medium. Seems stable now. Another point for the VRAM theory.
No idea if this is related to VRAM; I know nothing except that I have 8 gigs on a laptop RTX 4060, so seems like Dragon32 is onto something. I'm inclined to believe the kind fella.
However, the redmodding wiki (https://wiki.redmodding.org/cyberpunk-2077-modding/for-mod-users/user-guide-troubleshooting) tells me that Japantown specifically has a broken mesh, that crashes when you use Material and Texture Override (https://www.nexusmods.com/cyberpunk2077/mods/5266). No idea if this is true, no idea if this is relevant; either way, good luck, ye who stumbled upon the same issue.