As a result of a long-term project accomplished earlier this week, subscribers are now seeing faster speeds and improved response times. Most subscribers are experiencing sustained speeds exceeding their contract limits (some are seeing double their contract limit), with an additional speed boost layered on top whenever possible for brief, non-sustained transactions such as web surfing. Continue reading
I’m happy to report that, as far as we have been able to determine, all our speed-related problems at Mockingbird Tower are now resolved. Assuming this announcement doesn’t generate a spate of contrary responses, our next task will be to arrange for incremental UPS protection at our towers, beginning with the ones that are most highly subscribed; and working with our consultants to assure that we can deliver to our subscribers all the untapped bandwidth currently available at our Internet gateway.
For the technically curious, a brief description of the source of our speed problems appears below. (Warning: unpaved roads ahead!) Continue reading
We found and corrected the source of the frequent four-second timeout pauses. Mockingbird subscribers will now at least be seeing consistent data delivery, just not yet at the speeds we would like to deliver. What the tower is delivering right now should be fine for browsing, mail, and even a Netflix movie, but heavy data demands like Windows/Mac updates will still take longer than usual.
We are continuing to work on the speed problem with our dedicated and knowledgeable consultants.
Condensed version: We’ve narrowed down the Mockingbird Tower problem to RF noise that spikes periodically. Our tower equipment and configuration are clean and validated. We now need to perform after-midnight testing over the next few days that will result in brief (10-20 minute) interruptions of service for a number of the subscribers on this tower.
Details and analysis follow for the technically curious. Continue reading
After several abortive ordering attempts (in which “in stock” on a website listing apparently translated to “let us check our warehouse” once the order was placed), we located a dealer with a replacement antenna actually in stock. We have been verbally assured that our replacement unit shipped yesterday, and are awaiting written confirmation including a tracking number. In the absence of nasty surprises, we plan to be replacing the Mockingbird central antenna this weekend.
We are also going to be subjecting the Rio Vista antenna (same manufacturer and model) to testing to determine if it shows any early symptoms of the same failure mode, in case a prophylactic replacement is indicated.
As of about an hour ago, we believe we have found our issue with Mockingbird Tower Central, and taken steps to provide immediate improvement. Although speeds are not at the level they were three weeks ago (due to suspected antenna hardware damage and pending part arrival and replacement), they should be greatly improved over the degraded performance seen over the past week. Please drop us an email if you are not seeing adequate performance for your equipment.
Technical details follow for the curious.
Today’s status for Mockingbird Tower subscribers…
The battle continues on the Mockingbird speed issue.
In the past two days, our consultant pointed us towards two problems that allowed us to more than double the bandwidth capacity between our gateway and the Mockingbird Tower. Maddeningly, this increased bandwidth availability is still not making its way out to actual tower subscribers, and we are still at a loss as to why not. (Note that this is not happening on our other towers.) Our next step is to install some more sophisticated metering software at our gateway for our consultant to use to analyze traffic and routing issues within our network.
Today the new, faster, weatherized router model we’ve been awaiting (for months) to order, to replace the mid-2013 board currently operating Mockingbird Tower, finally hit US distributors’ shelves. We express-ordered one, which should arrive late on Friday. We plan to get it installed over the weekend, possibly solving our problem in whole or in part. (At the very worst, it will allow us to rule out a router hardware problem.) This installation will involve a brief outage, as cables have to be moved en masse from one unit to the other.
We wanted to let you know how the work is progressing, and that the Mockingbird speed issue is still our top priority… to the point where we have suspended all new subscriber installations to Mockingbird Tower until we have got it beat.
Thanks for your patience while we conquer this problem.
Our performance problem with Mockingbird Tower unfortunately wasn’t affected by replacing the radio driver on Tuesday.
We’ve since spent two very late nights (until 4 AM) attempting to locate the true cause of this problem. We’ve checked for queueing and routing problems, limitations on link capacity, RF issues (such as improper equipment orientation, local interference, and — our perennial bugaboo — a subscriber with degrading signal strength whose retry requests overwhelm the tower and destroy performance for all other tower users). We’ve temporarily backed out recent configuration changes to see if any of them triggered the issue. Despite our efforts, the problem continues to defy explanation.
On Wednesday, we contracted with the largest MikroTik consulting firm in the US to look at this problem, as well as the challenge of delivering increased bandwidth to all our subscribers on all towers. We’ve been assured that their engineers will begin work on these tasks on Monday.
We’re sorry to have no interim fix available for this problem. As other potential causes suggest themselves to us, we will continue to test them, and either repair them or eliminate them from consideration. We want you to know that if you are a Mockingbird Tower subscriber, we are not ignoring you — we are aware of your speed issues and we are working on them.
Thank you for using Grand Avenue Broadband.