I have found what the issue was. The video I was working on was shot using the Filmic Pro app. This was the first time using it and I must have had the quality setting set to "Filmic Ultra" which gives extremely huge files. I did a comparison of file sizes shooting at 4K for 8 seconds, same stationary scene. The pixel 6 native camera app gave me a 73MB file. Filmic Pro standard gave me a 104MB, not much difference. The Filmic Pro Ultra gave me a 563MB file size for 8 seconds. So when I checked the project I was having issues with, the clips were 2.5GB each and I was working on around 6 of them with speed warping and graphics. I recently shot some 4K video on my Nikon Z6 and there was no issues editing the video. The size was the problem. I did see a chart of GPU performance in Premiere Pro and the 3060 was at the bottom. The 3080 seemed to be the best price vs performance option when viewing the chart. There was a huge jump from the 3060 but not as big of a difference when compared to the 3090 series.