Need native check, I don't rally like the repetition of 彼女, but just たまに見る seems weird....

Ah oui, tu as raison pour のに, plus approprié.
会う en négatif c'est 会わない pas 会いない :p
Mais je ne comprends pas pourquoi le しか ?

I'd use のに　instead of が and maybe たまにしか会わない instead of 見る, but I may be wrong.

>彼女の家の辺りに暮らすのに、たまにしか会わない。

Oui je viens de corriger mon erreur, je comprenais pas pourquoi je trouvais pas cette forme sur google !
しか + verbe à la forme négative exprime l'idée de "seulement", un peu comme だけ, qui s'utilise avec une forme positive.
Pour exprimer "rarement" avec たまに je crois qu'il vaut mieux utiliser le verbe à la forme négative sinon ça signifie plutôt "de temps en temps".

Yeah, I saw this sentene after I added this one, and I thought mine was different enough to be interesting to add.

I think changing 暮らす to 暮らしている will make it better, but I would say differently.

I would say:
彼女とは家が近所なのだが、
彼女とは近くに住んでいるのだが、
彼女は家の近所に住んでいるが、

Thanks !

がが、

Hi mookeee, is the use of のに incorrect here ? Or is it just more natural to use が and why ?

I'm sorry for having ignored your suggestion. My suggestions are based on Quazel's second version. Using が is correct and I personally like it, so I left it as it was. Using のに is also correct, natural and perhaps clearer, because it indicates the adversativity between the clauses, while が can be used for simple connections.

I added another one with のに :)

Here is an alternative for 会わない.

彼女は家の近所に住んでいるが、たまにしか見かけない。

見かける indicates "to see" and I suppose the speaker usually doesn't talk to her. While 会う implies "to meet" and sometimes there is conversation.