No they don't enter a water jacket. They are one inch deep and stop. But they do go through the water pump housing and attach it to the block. Could be heater hoses.

Here are pictures of an AC car with the idler removed and installed.

I'm working on a 1957 392 and I cannot believe how many bolt holes go into the water jackets. Crazy really.