Warts can occur anywhere on the body, but they are most common on the hands, fingers, and toes. Moles are most common on the face, neck, and arms. Warts are usually small and rough, while moles can be either small or large and may be smooth or hairy. Warts may go away on their own, but moles are usually permanent.