MINECRAFT question (Nether portal)?

okay so i had this 1st house place and i built a portal. then i moved and built an entire new house FAR away from the 1st and i destroyed the 1st portal so now i only have the one portal at the 2nd house and i keep poping back up at my first house with a brand new built portal...how can i use the portal at my 2nd house without poping back up at my 1t house?