tysonlowery
Change to how league news works
July 11, 2006 at 02:08PM View BBCode
As you know, the league news page has become very slow for many dynasty and private leagues.
Here are the technical details if you care, you can skip this paragraph if you do not care. The issue is that as a league accumulates news, there isn't a way to segregate that data in the database to make queries and reads of that data very fast. For example, in the Koufax league which is in 2024, there are about 20,000 news items all time. So to display data on these pages, the most efficient way the database can segregate the data using indexes is to limit it by league and get the searchable dataset to 20,000 items. I tried about 10 different things yesterday, but that's as small as I could get the searchable dataset to. Which means the page is going to be very slow.
So we have changed how the news works. The most recent 200 news items will be stored in a seperate area. Only these items will show up when you browse the news area, unless you click the link at the bottom which says "show more news". I don't expect many people will ever want to see the older news, but just in case it is there for you.
tysonlowery
July 11, 2006 at 02:09PM View BBCode
Depending on how well this works out, I might look to increase the 200 to a higher number, perhaps 1000.
BleedRed
July 11, 2006 at 03:24PM View BBCode
Can you clarify how this change will affect player card displays and within a category?
Will it show all the player's past transactions or only those within the past 200 total league transactions. In other words, is this 200 total league transactions or 200 transactions in a given category?
For instance, if after a busy offseason (40-50 retirements, 40-50 waiver transactions, 20-30 promote/demotes and a few other transactions), if I go to completed trades or to a player card, how many transactions will I be able to see?
tysonlowery
July 11, 2006 at 03:45PM View BBCode
Player cards are using yet another system now, the one put in on Sunday night. They will always display all news.
rnznsmn
July 11, 2006 at 04:17PM View BBCode
Tyson,
When I look at the Completed Trade history in the CSL, I'm only seeing *1* transaction, and then the link for "show older news". Is there a bug here?
tysonlowery
July 11, 2006 at 04:26PM View BBCode
Nope. Out of your leagues last 200 news items, only one has been a trade.
rnznsmn
July 11, 2006 at 04:32PM View BBCode
Originally posted by tysonlowery
Nope. Out of your leagues last 200 news items, only one has been a trade.
Ahh, I see. So it's not the last 200 trades, it all the trades from the last 200 news items.
Personally, I'd be concerned that may be a little confusing. If you have a league that has a lot of promotion/demotion activity, you might not even see all (or ANY of) the trades from the current SEASON, much less prior activity.
If it turns out that you can bump the quantity from 200 up to 300 or 400, I think it will help greatly. Because frankly, in the current form, I find this LESS helpful than the slow process before - now not only do I have to wait for the full news page to load, but now I have to select completed trades, THEN click show other news, and THEN wait for the same page load time as before - just to see a trade that occurred LESS than 1 season ago. I can understand truncated stuff from 4-5 seasons back, but I can't even get a season's worth of history.
tysonlowery
July 11, 2006 at 04:38PM View BBCode
200 should be enough for the last season in most leagues I suspect. I can probably bump this to 1000, let's see how next week goes.
The site can't handle this any other way, it was causing problems with game, trade executions, etc. So its either this or nothing unfortunately. I can't even show you the last X trades, the logic to do that is too complex for MySQLs triggers.
rnznsmn
July 11, 2006 at 04:47PM View BBCode
Originally posted by tysonlowery
200 should be enough for the last season in most leagues I suspect. I can probably bump this to 1000, let's see how next week goes.
Tyson,
For what it's worth, 200 news items does not cover an entire season in any of my leagues. The blocking point seems to be primarily the HUGE number of transactions that occur in the first two weeks of the season, with all the waivers, promotions/demotions, etc. However, there's also a lot of September 1st an dend-of-year activity in some leagues that also messes it up.
If you could get to 400-500, you'd probably capture about 1.5 seasons, which should be reasonable. If you can get to 1,000 news items, that's probably better.
I guess we'll see what the server can handle as we move forward like this! :)
~rnz
PS- I guess this means we won't be adding other news items like injuries anytime soon, eh? :)
redcped
July 11, 2006 at 05:43PM View BBCode
Personally, I check news every day or two in real time, so unless there is an absolute flood of activity I rarely have to scroll down much at all.
I think for the large percentage of time seeing 200 items quickly will be quite beneficial for speed and convenience. Yes, there will be times (retirements and start of new season) when you have to wait like before, but I'll take this improvement gratefully.
rnznsmn
July 11, 2006 at 05:50PM View BBCode
Originally posted by redcped
Personally, I check news every day or two in real time, so unless there is an absolute flood of activity I rarely have to scroll down much at all.
I think for the large percentage of time seeing 200 items quickly will be quite beneficial for speed and convenience. Yes, there will be times (retirements and start of new season) when you have to wait like before, but I'll take this improvement gratefully.
Red,
Personally, I check the trade news a lot because I'm an active trader, but not much on the other stuff.
But to not even see the past 12 game-months of trading now is a little frustrating.
rnznsmn
July 12, 2006 at 05:54PM View BBCode
Tyson,
Just a quick update - I'm checking the impact of 200-day news for the new season of the CSL, which kicked off today.
The league date is 4/4, and I can't see any news further back than the retirements that occurred in November of the prior season. In other words, we're only 5 games into the current season and EVERY transaction from last year's regular and playoff season has already been truncated.
I really hope we can expand this beyond just 200 news items once you get a sense of the server load!
tysonlowery
July 12, 2006 at 05:56PM View BBCode
rz - you might have missed this, but you do see the link that says "see older transactions" or something to that effect, right?
rnznsmn
July 12, 2006 at 06:07PM View BBCode
Originally posted by tysonlowery
rz - you might have missed this, but you do see the link that says "see older transactions" or something to that effect, right?
Tyson,
Yes, my point is that because I can see so little of the history, I have to click on that link EVERY time I'm looking at the news.
So now, it takes just as long as it did to load before (because I still have to load ALL of the news just to see last year's transactions), but now it's even WORSE than before because I have to actually load the fast version of the page, then follow another link just to get the same list I used to get before without multiple clicks.
Pages: 1