"The Jews should rejoice in their Maker. Every Jew should share in G-d's joy, Who rejoices and is happy in His dwelling place in this world." (Tanya, Chapter 33)
Every Jew, no matter what sort of background or learning he or she has had until now, even until a minute ago, so long as he is a Jew, he is a member of the Jewish people; and he should be happy and proud that Hashem has given him the special and greatest mission he could have -- to make himself, his home, and the world around a place where G-d is found.