Rubin is also director of the Pentland Group - which owns brands including Boxfresh, Ellesse, Speedo and Hunter - has previously won accolades as one of the best companies to work for in the country - and European vice president of the World Federation of the Sporting Goods Industry.
"He has experience of brand development outside of Europe, which will be of considerable use in supporting the continued successful global expansion of the group," JD Sports said in a statement this morning.
Pentland Group owns a 57.47 per cent stake in JD Sports.
Peter Cowgill, JD Sports' executive chairman, added: "I am pleased to announce that Andy has agreed to join the board. His experience of managing and developing brands internationally will add to our board as we continue the international expansion of the JD brand."