Yeah, looks like you're using the cpu fan that came with it, those things are small and can get loud when your cpu is put under pressure. Go ahead and take a look at the program called coretemp... set it to start alongside the bootup of your computer (settings) and don't play any games on the computer, an 20-30 minutes later look at the max and low temp, what are they? Reboot the computer and when it starts up, run universe sandbox for ~ 20 minutes, if it can safely do so ( I don't know how long you've been running it in the past). Now look at the max temp, what is it? Universe sandbox is a cpu intensive game, and will be much harder on an older CPU (especially an older AMD cpu). I have an AMD fx-8350 (eight-core cpu), and I put it through its paces at 100% load for, at times, over a week of non-stop ray-traced rendering (My hobby is 3d rendering and simulating fluid dynamics). I keep a close eye on my temperatures, and the only reason I haven't burned out the cpu is because I bought a cheap 120mm cpu fan & heatsink, you can get one for less than $30 on Newegg. So if you can't afford a newer processor (once upon a time, I also had an AMD athlon x4), then at least you could keep those temps under control with a 120mm heat sink and fan.
-One more thing, if you purchase a 120mm heatsink/fan, to be on the safe side -(search this on newegg "EVERCOOL F-EC12025H12BP 120x120x25mm High Speed Double Ball Bearing Fan" -this is the fan I currently have, the first 120mm that came with my heatsink didn't last so long under the stress I put it under, and I came home to find a fried 8-core processor (FX-8150). The fan I have now (in the link) has been put Under stress of a cpu at 100% load for over a week multiple times, and my max temps couldn't reach 60 celcius. It's a good, cost-conscious solution to overheating)