Weird baked result in blender metal material

Hey guys, I'm trying to apply a metal material on my object in blender. The rendered result looks great, but the baked result has some weird white/grey patches that I can't for the life of me get rid off. I have my .blend file here. My UV unwrapping skills aren't great, I don't know if that's the problem here. Thank you!