It's either your belt tensioner/idler pulley or both. You should replace both at the same time. Check the DIY's on how to do this.
Current Vehicles in my stable:
2005 BMW 330i - 105K miles
2005 Mazda Tribute s - 100K miles
1998 Ford Taurus SE - 108K miles
1987 Ford Mustang LX 5.0 - 234K miles