I found an article on adding some code to the functions php file to stop Jetpack from adding OG Tags since Yoast SEO is also doing so.
I'm going to try and add them and see if it helps.
So unless you think this is a bad idea I think I may have a solution. Thanks for your help in getting me on the right track. I'll post when it's done to let other's know if this solved the problem if they should encounter the same issue.