I thought Perl is what is holding the turtles together?

It's turtles.pl all the way down.

For sibling post:

"Turtles all the way down" is a "a jocular expression of the infinite regress problem in cosmology posed by the "unmoved mover" paradox."[1]

http://en.wikipedia.org/wiki/Turtles_all_the_way_down

So, I feel like I might be being stupid and not getting something, but what is turtle? I can't find a programming language that seems to be related to it.

Count is correct, but I did have a flash to my childhood: http://en.wikipedia.org/wiki/Logo_(programming_language)

That was my first thought too but I figured they couldn't be referring to that. :)