I do think it is a good idea though to move Elsweyr away from a purely "oriental" theme, since that is already occupied by the Redguards. just because both Hammerfell and Elsweyr have desert regions doesn't mean that the architecture needs to look arabic-oriental.
the indian/indonesian influenced architecture from ESO, especially the temples, is a good start. maybe now that you have created some resources you can start to expand this style a little bit and mix in your own ideas
by the way i think ancient Khmer (KHmer/KHajiit, coincidence?

) architecture probably influenced the ESO temples
the question is what does Khajiiti iconography look like? how do they display religious symbols, how do they depict their saints etc.
i haven't played ESO so don't know if that has been covered aswell.