Yes, yams can be substituted for sweet potatoes in recipes and vice versa. The two can be used interchangeably. Yams have thinner, smoother skin than sweet potatoes. Yams have brown skin, while sweet potatoes are yellowish. Sweet potatoes are moister and yams taste slightly drier. Sweet potatoes have a sweeter taste than the starchy yam.