I understood what you were doing but we needed to narrow down where the issue is.
If you are sure the problem is when you are setting the buffer to psram are you 100% sure of the model of the ESP32-S3 you have. I have 2 here sitting on my desk where they were not the ones that I ordered and the ESP32-S3 had 8mb of flash and no additional memory. Even tho they used the model number for one that had 8mb of ram and 8mb of flash.
if you use esptool you will be able to identify the exact model number of the ESP32 to make sure you actually got what you paid for. It sucks when this kind of a thing happens but it has happened to me and I was pulling my hair out trying to figure out why I was having memory problems.
The other thing is you have to be careful of what GPIO pins you are connected to. depending on how much PSRAM there is is going to use more or less GPIO pins.
On the S3-WROOM2 there is no worry because the pins should not be broken out. But on the WROOM1 they are probably broken out. There are 3 pins you have to make sure you are not connected to. I am saying this because the problem will now show up until you try and use that SPI memory.
Here is a list of the model numbers and what the chips have for flash and for spiram. The models that have use of the additional pins have the GPIOs marked. You cannot connect anything to those pins if you have any of those model numbers.
ESP32-S3-WROOM-1-N4 4 MB flash
ESP32-S3-WROOM-1-N8 8 MB flash
ESP32-S3-WROOM-1-N16 16 MB flash
ESP32-S3-WROOM-1-H4 4 MB flash
ESP32-S3-WROOM-1-N4R2 4 MB flash 2 MB spiram (Quad SPI) -
ESP32-S3-WROOM-1-N8R2 8 MB flash 2 MB spiram (Quad SPI) -
ESP32-S3-WROOM-1-N16R2 16 MB flash 2 MB spiram (Quad SPI) -
ESP32-S3-WROOM-1-N4R8 4 MB flash 8 MB spiram (Octal SPI) - GPIO35, GPIO36, GPIO37
ESP32-S3-WROOM-1-N8R8 8 MB flash 8 MB spiram (Octal SPI) - GPIO35, GPIO36, GPIO37
ESP32-S3-WROOM-1-N16R8 16 MB flash 8 MB spiram (Octal SPI) - GPIO35, GPIO36, GPIO37
I had ordered ESP32-S3-WROOM-1-N8R8 devkits and what I got was ESP32-S3-WROOM-1-N8. The company refunded me my money and told me to keep the ones that I had gotten but the time lost trying to figure out what in the world was wrong is something I will never get back. It took me a long while to figure it out.