The Imperial Family of Asaka was established in 1906 by Prince Yasuhiko, the eighth son of Imperial Prince Asahiko Kuni. In May 1910, Prince Yasuhiko married Imperial Princess Nobuko, the eighth daughter of the Emperor Meiji. In 1921, the prince was granted 33,000 square meters of land in Shirokanedai. In October 1922, while working for the military college.

Prince Yasuhiko left for France to undertake military studies. However, in April 1923 he was involved in an automobile accident in a Paris suburb. Princess Nobuko traveled to France to nurse her husband, and both the prince and princess remained there until 1925. Paris in 1925 saw the opening of the Exposition Internationale des arts decoratifs et industriels modemes, more commonly known as the Art Deco Exhibition, and with it the finest flourishing of the Art Deco style. Prince and Princess Asaka attended the exhibition on July 9, 1925, accompanied by Paul Leon, Deputy Commissioner-General of the Exposition. Upon returning to Japan, Prince and Princess Asaka settled in a residence in Takanawa, but in 1929 the prince set to work on his own house in Shirokanedai. The new residence of Prince Asaka incorporated the best of the Art Deco style, and was completed in May 1933. Regrettably, however, Princess Nobuko passed away in November of that year, but the Residence of Prince Asaka continued to serve as the home of the Imperial Family of Asaka until some time after World War II. In October 1947, the Imperial Family of Asaka renounced their membership in the Imperial Family, calling themselves the Asaka family, and moved to Atami.