The word ultimately derives from a Dravidian language – possibly Tamil நாரம் nāram or Telugu నారింజ nāriṃja or Malayalam നാരങ്ങ nāraŋŋa — via Sanskrit नारङ्ग nāraṅgaḥ “orange tree”. From there the word entered Persian نارنگ nārang and then Arabic نارنج nāranj. The initial n was lost through rebracketing in Italian and French, though some varieties of Arabic lost the n earlier.
The word “orange” entered Middle English from Old French and Anglo-Norman orenge. The earliest recorded use of the word in English is from the 13th century and referred to the fruit.
In my mother tongue, also a Dravidian language, narangayi means lemon. Orange is actually called chitt-puli.
It was kept in Spanish tho, naranja.
Same in Hungarian, narancs.