The family claimed descent from Shibukawa Yoshiaki, the son of Ashikaga Yasuuji, a relative of the Ashikaga shōguns. Over time, the clan evolved into several branches which were daimyō, ruling the Bitchū-Matsuyama, Niwase, Fukushima, and Annaka Domains.