We had grown some once. I knew it was thyme as I saw the seed package. Thyme, basil, oregano and so on are all the same family. All in the mint family.
Grew some lemon thyme last year. That was leafy and hard to discern between that, oregano and mint. ( besides smell)
Had to keep the little plastic named stakes in place.
For the 2nd one, the smell did remind me of something that would go on pizza.
I had thought it could be basil, but the pictures online of basil plants had bigger leaves.
After @JimK said oregano, I took my shaker spice jar, and compared the smell with that, and the plant. I think this is it, oregano.
The picture online of oregano also seem to match this leaf size.
Thanks everyone. I should have asked years ago.
I moved back into this house in 2015. My sister used to live here before. I asked her what these were, but she couldn't remember exactly anymore. I know there used to be a basil plant, but I had heard it got destroyed. But even knowing that, I still thought the ones in the picture could have been basil, I thought maybe she replanted them, or maybe a part of it had survived and eventually grew back. I couldn't think of what else it could be.