Have your sentence native-checked, Natan, mainly about the articles.

You go to church (without an article) when you think of the church service and go into the church (with the article) when you think of the building, I suppose.
And the pastor - is it a minister maybe? - does not go to church like other people. Hard to say whether you want an article here or not.
Anyway, as far as I know, it is definitely "the Palatinate" with an article. Compare: http://www.romantic-germany.inf...te.4108.0.html and http://oald8.oxfordlearnersdict...ary/Palatinate #2

I think you might be right. It's a bit more difficult because I chose a Wort-to-Word Translation.

And yes, it's a common sentence without plenty of real sense, because this is only to demonstrate the standart-german "pf" missing in the palatine german dialect.

If that's the case, Natan, and it's really a kind of tongue-twister, one could also say something like: "In the Palatinate the pastor goes to the pulpit with a pipe" to maintain the alliteration.

Just an idea. Needs native check, too.

It is a so called "Schibbolleth". A sentence which characterizes the special stucture of a dialect.