Use of online shopping sites, such as Amazon and Rakuten, has increased in recent years. Many shops participate in these sites. The categories of shops represent various intended uses for listed items. For example, a flashlight is often used for camping or emergency items, so some shops use a category such as “Outdoors” or “Emergency Supplies” for that item. In this paper, we aim to build a recommender system for specialty shops based on the viewpoints of items browsed by users. We first extract viewpoints of browsed items by using category structures of online shops. Through this, we analyze the category structures and selection of goods to determine specialty shops.