I wouldn't be afraid to eat the yolks, there is still a lot of debate whether dietary cholesterol even affects blood cholesterol levels.