EDITOR’S NOTE:
We have also been “asked” to remove Starcity prices form our site. We have pulled the prices for now.
The reason for removing the prices was simply that it wasn’t worth the time and effort required to keep up with their constant attempts to hide the data and they were almost NEVER the lowest prices vendor so the added gain to our users was very minimal.
On average, Starcity was 12% more expensive than almost every other vendor for almost every other card we looked at. Since each vendor is selling an identical good, sending people to SCG seemed silly.
That being said, some people still want SCG prices for comparison. Since mtgprice.com has some funding, we’re fortunate to have some excellent IP and Internet lawyers available to us (www.dlapiper.com). Rough advice from them follows (note: this is NOT advice to anyone else, it’s just me paraphrasing our own personal legal situation):
1. Price information is simply a statement of facts. You cannot copyright it. This is a 1991 Supreme Court decision. Relevant case law is here: http://en.wikipedia.org/wiki/Feist_v._Rural
In my opinion, for the C&D author to claim “such action may also constitute an infringement of SCG’s intellectual property rights” implies that one of the following statements is true:
a) They are a terrible lawyer that doesn’t understand basic case law.
b) They are lying.
c) They think the word “may” means “doesn’t in any way”.
2. Terms and Conditions on a website need to be affirmatively agreed to to be binding. If I added to the T&C on mtgprice.com “Anyone from starcitygames.com that visits this site owes me $1 Million USD per visit”, it would be irrelevant. (Even if they DID agree, it would be unconscionable but that’s besides the point). Importantly, we have been careful to never accept these terms and conditions (which is why we stopped offering buylist prices earlier this year).
3. The recent 3Taps/ Padmapper/ Craigslist ruling CAN make “circumvention” unlawful, however the exact definition of circumvention is hazy. The EFF has a nice writeup of this case here: https://www.eff.org/deeplinks/2013/08/court-rules-accessing-public-website-isnt-crime-hiding-your-ip-address-could-be
For us, we decided that the simplest possible thing to do would be to use Amazon Turk to crowdsource the pricing data. In other words, get real humans to connect to starcitygames.com and simply tell us how much they are charging for each card. Using Turk, we estimate that we could get every modern card’s price for less than $10/day. If there is demand for this, we will probably go this route since it both avoids all of the technological measures SCG are using and it’s 100% legal.
Please note: We have repeatedly offered Starcity free advertising for their data. We are also willing to pay directly for it, or to take any reasonable steps needed to limit any server load they may encounter.
Ultimately, we doubt this is about server load. We feel that Starcity simply don’t want people to be able to compare their prices as SCG prices are so frequently much more expensive than their competitors.
This is something we are willing to fight if it’s of benefit to our users. If you’d like to continue to see SCG prices on our site, please let me know at webmaster@mtgprice.com or post below.
ORIGINAL ARTICLE:
By: Jared Yost
How much power does Magic market information have when it comes directly from a market leader? To what extent are we willing to go to make sure that we are getting the best price for the cards that we trade or buy? To what extent are companies willing to go to protect their business data from being used in ways which they may not approve? A controversy has come to light surrounding these questions.
Recently, an interesting post has appeared on Reddit about Starcitygames (SCG) locking down the information on their website. A brief history of dawnglare is as follows. Reddit user dawnGlare created the website http://mtg.dawnglare.com, which is a price scraping tool used to display card prices for Magic cards. Some of you may remember the website ark42, which is what Dawnglare is based upon. It was the original Starcity price scraper that was used to quickly lookup sell prices, and was quite popular to boot. The owner of the ark42 website seemed to have a falling out with their local Magic community, which is explained in his monologue that has replaced the original website. I don’t think Starcity had any hand in ark42 shutting down like the current dawnglare situation. It operated for quite a while before it was shut down and it was a shame that such a wonderful contribution to the community is now dysfunctional because of a few bad apples.
Dawnglare is the replacement for the ark42 tool, with both of the websites utilizing similar, if not the same source code to display card names, prices, and mouse-over pictures of the cards. The tool has not been available too long; a few months at most. Like ark42, Dawnglare utilizes Starcity prices, and in addition have stated that their goal is to incorporate TCG mid prices for cards as well. The website is still functioning with only Starcity prices because it appears that the owner is seeking community input before they move forward with either improvements to the service or shutting it down.
This article is not providing input on whether or not they should keep the website, but rather analyzing the situation and providing commentary.
A summary about the case against Dawnglare:
-
Starcity sent a cease and desist letter to the Dawnglare site admin, which means that they are utilizing legal representation in order to enforce their data policy (in other words, they aren’t playing around once they get lawyers involved.)
-
Starcity quoted their website’s terms and conditions in the letter, which state that ANY type of information on starcitygames.com cannot be scraped programmatically
-
This point is important, because information defined here also includes the sell prices of the cards, not only just the buylist prices. Many people on the Reddit post were confused on this point because Dawnglare reads only the sell price, not the buylist for Starcity, which specifically carries a set of terms.
-
Starcitygames.com’s terms and conditions state that the user must agree to them
- This is interesting because there isn’t any agreement page that you need to go through before accessing the main website in order to see sell prices, unlike the buylist. However, though this may seem unintuitive, it could actually be the case that just using the website makes you subject to the Terms and Conditions. It could be argued either way.
-
Starcity stated that dawnglare has committed a breach of contract with the website for its automatic scraping
-
Staricty claimed that the sell price data on its website are valuable rights of the organization
-
Starcity gave the Dawnglare site admin until December 2nd, the date of this article publication, to comply with their demands or face legal recourse
-
Starcity mentioned that legal disputes can only be fought in a court in Roanoke, VA, where their physical store is located
-
I’m not sure about state law in regards to the internet, though it would definitely be weird to go to court with this if the Dawnglare site admin is not located in VA
Let me say this now – I am only providing my opinion on this controversy based on the details outlined by Dawnglare on the original Reddit post. I have no idea if the Dawnglare site admin altered the letter Starcity sent them in any way nor do I have any way of knowing if Starcity will continue with their legal recourse for the Dawnglare price tool. I simply wish to start a conversation with players about how far organizations are willing to go to protect their data about real-time card prices, even if the data seems innocuous. Moving forward, this can also lead to implications about access to financial data of cards.
First, let me address one issue at hand – Starcity wishing to protect their data from a technological perspective. As an organization, especially one with a detailed terms of service expressly forbidding certain actions, they have a right to protect their business interests if they feel it will affect them in a negative way.
How can a price scraping tool affect Starcity negatively? A major concern is that external sites could cause a massive strain on server resources for Starcity, such that if several tools like Dawnglare are scraping their website for information it could hamper the website’s response speed. If any of you have used the Starcity deck database search or advanced card search, you can already see that their searches are somewhat slow. It can take quite a while to return a results from an advanced search. With so many users already searching the database, adding a scraping tool that is constantly pinging the database only stands to make things worse.
Of course, you could argue that Starcity should upgrade their servers and increase their bandwidth to the website to eliminate these problems, which would negate the effects from any tool that would also scrape the information (think Google, Amazon,or any other big name retailer – programs scrape their information all the time and it does affect the website’s speed). Unfortunately, Starcity is either not in the position to do this or is allocating their budget elsewhere, which means trying to cut bandwidth costs in other ways.
If Starcity uses legal recourse to cut server bandwidth overutilization rather than put the funds towards upgrading their server capacity, which could be argued to be the cornerstone of their business then there may be other motivating factors at work. This leads me to believe there are business considerations for going after tools like Dawnglare. I am not alone in this analysis of the cease and desist letter.
The other reading of the situation is that Starcity is not only protecting their data from a technological perspective, they are also protecting their data from a business perspective. This issue is centered around whether or not Starcity went too far in persecuting Dawnglare for creating a tool to scrape their prices. From a legal perspective, could you define any type of data on your website as “valuable rights of the organization”? Is the information considered public or private if anyone with an internet connection and the website address can access the information? Whether or not it is public is not up to me to determine, only someone with a better understanding of business and internet law can make that determination. When looking at the website though, anyone can access Starcity’s sell prices- all you need to do is go to starcitygames.com and and start typing.
Even this set of questions brings up another question – does this mean that you are already agreeing to Starcity’s terms of service just by executing searches against the information that they make available on their website? Since you don’t have to actively agree to anything in order to just search for the sell prices, this could definitely be contentious when arguing whether or not issuing a cease and desist is the right call.
After considering all the information as we have it, the next issue is whether or not a programmatic search through a tool like Dawnglare, even though it may execute hundreds or thousands of searches per minute, has the same rights and merits as a manual search executed by a single user. It could actually boil down to the rights of the user to access a particular amount of data on the website, measured in kilobytes, which is really the only difference between the tool and a normal website user. If the tool really is causing negative harm to Starcity (for example having them complete extra server maintenance due to all the extra searches from a single source) then there is an argument to taking down the tool – after all, DDOSing a website is a real thing and can wreak massive havoc on any web service.
From the community’s perspective on all this, Starcity does not appear to be operating any slower than usual, so there must be something going on behind the scenes that Starcity does in order to balance out the extra load from the scraping tools. Maybe not though. It could just be that they are trying to protect what they perceive as their business model.
Circling back to the cease and desist, the real issue is that Starcity is trying to stop application scraping of their website through third party applications and whether or not their outlined legal explanation (as per user dawnGlare on Reddit) is powerful enough to stop this type of behavior in the future. Since I a not a lawyer, I can’t give a grounded legal argument for continuing or discontinuing the scraping of information that is outside of the website’s terms of service, but it is interesting at this point in time that Starcity is cracking down on applications. I’m not even sure if Dawnglare is the first site they’ve contacted about this issue. There could be others out there who have decided to shutter their applications once they received the letter.
In addition, I think it is intriguing that Starcity is choosing to enforce their rights against someone who is not just scraping buylist prices, but sell prices as well. I’m not sure why the sell price in particular needs to locked down. In order to access buylist prices for Starcity you need to log into the website and agree to their terms by clicking a specific button. This can easily be linked to agreeing to their terms of service – the terms are on the prompt before the buylist. Whether or not this information should also be heavily protected behind this type of agreement can also be debated, since the buylist information can also technically be accessed by anyone because technically anyone can create an account with Starcity and access the buylist. Starcity most likely put that road block in place in order to easily shut down accounts that were created strictly for applications that intend to scrape buylist information.
The real root question here is why does Starcity care so much about people mining its sell price information? Do they have so much sway that if they change their sell prices it could possibly create a market-wide shift, ultimately interfering with their business practices? I will definitely be following this case in the future to see what happens, because the outcome could have major impacts on the way that people access card price information if other organizations follow suit.
The outcome of the Dawnglare website cease and desist notification will have implications for buylists and possibly more going forward. It might even spark conversation on the power that Starcity wields over the market and the lengths that they will go to protect their market position. It could also mean that in the future other stores may start locking down their website information, which further and further separates the movements of big box Magic stores from the community. I’m personally against restricting access to information, however with private organizations my opinions don’t matter and at the end of the day. It comes down to the fact that an organization should have a way to protect their data.
But how far is too far? I think that is question that everyone is trying to answer, in order to find a happy medium between Starcity operating as a business and other third-party tool creators wanting to use their data in order to create more valuable applications for the Magic community. After all, we all love this game – we all want to see it succeed both through Wizards and the stores that support them. I hope that both parties are able to resolve the dispute amicably and in a way that still benefits the Magic community at large.
Scg could just ban the Dawnglare IP. In the case of that Dawnglare is using dynamic IP, they can implement a captcha every 5 searches. This is what all sites are doing, instead of demanding the “scracher”. I don’t know why SCG is not doing the same.
I am not sure how SCG could really deal with this through a legal action. I think they try to frighten server admin with this. The sole letter is generally enough to get the admin shut down the targeted website as they dont want any legal problem whatsoever… This serves on a short term action, but the result on the long term seems hazardous.
I think the main issue for them consists in (by descending likeliness) :
1) Divert audience from their own website where they can put some crosssell / upsell actions (say like Amazon : you are looking at Griselbrand price and they say “hey other people who looked at Griselbrand also bought…”) + analyze buyers behaviours and enhance their sales efficiency
2) Once everyone knows that there is a single source website for prices benchmarking and everybody goes there to check, some ill-advised people could tweak the “SCG prices” to show whatever they like and benefit from this incorrect information. If the tracker IT security is lower that that of SCG, the risk exist that is used to generate DOS attacks (WHAT ? SCG has dropped their Didgeriddo sale price at 1$. Lets buyout everything they have in stock !)
3) They run their own price tracker that they pay for to benchmark competitors. This kind of tool is a huge competitive advantage enabler as it allows to analyze competition real time, know how much price drop they need to put to give a boost to sales volumes…)
hi, I think only looking at the cost of bandwith and server is only partial correct.
Somebody needs to be payed to insert and update the data of all these cards.
I think that will be a driving force, why should SCG carry the cost for other people to profit from?
If you are serious about your tool and what to use data, you should negosite a fee for thiis service.
And i hear you thinking, yes but they need to update it anyway, the next step would be, i setup a webshop and scrape the data from their site to populate my price lists.
The postman comes to every door but still you need to pay to get your letter delivered.
Stieve
I think that what Star City Games is doing is right. As a person who uses their website I support them fully.
Would you mind elaborating? I’d love to hear a dissenting opinion.
How do you use scg for ?
What are you talking about when say doing right : the legal action, their defense of their data / website, the design of their website…
I would like to hear some lawyer point of view on how this is handled anf wether this is a smart move from scg (or not which is my current opinion) ?
I happen to believe that SCG has the right to protect their prices if they want. That said, they aren’t doing it in a fair and acceptable manner. In order to have Terms and Conditions that actually bind people, they have to assent to them. Since you can view SCG prices without an account or ever clicking that you agree with the terms and conditions, they are not binding upon people merely viewing those things that are freely available to the public without said clickwrap.
If SCG wanted them to be binding, they would have to make it mandatory for people to accept Ts and Cs to see their website. That would be bad for business, so I doubt they will. If they want to bind people to terms and conditions, however, this would be the only way I can think of to do so (I’m a law student, and have been studying this issue this semester. The legal side of my “opinion” isn’t really an opinion so much as it’s a restatement of previous court cases decided in U.S. courts.)
VaultAge makes some very good points. Their are a lot of reasons that StarCityGames.com does not want other people to scrape their prices. And legal action can come from some unexpected places.
1- Extra server load from 1 site scraping them is not likely to cause to much of a problem. But it is a slippery slope. If they don’t take a visible stance against scraping, then everyone with any coding experience will be hitting them on a daily basis. THAT is where the server problem really start. Where do you draw the line? What’s to stop some enterprising individual from scraping your entire database every hour on the hour? Every half hour? Every minute?
2- If someone makes a website that displays data and requires upkeep. They are getting something out of it. People rarely if ever do something like that out of the good of their heart. Whether it’s page traffic to generate advertising dollars or the fact that they have an ulterior motive, (such as discrediting SCG) they have a reason which will not be in line with StarCityGames best interests.
3A- Accuracy. This is probably the BIGGEST reason I would not want someone scraping my site prices. In essence they are taking it upon themselves to speak on my behalf. That is not OK. How do I know what they are saying is accurate? How do I know they aren’t altering the numbers for some nefarious reason?
Example: Third party site sets up a “Dawnglaresque” site and displays their prices alongside scraped data from my site. They then change key “SCG” prices in such a way as to shine a false image upon my operation therefore clenching sales for themselves.
3B-Accuracy When did they last update their prices? As quickly as a site like SCG changes their prices, I find it hard to believe that a scraper site is going to have the correct numbers all the time. And SCG has no control over that. If SCG changes the way their back-end is arranged and breaks a few of the item keys in the scrapers script so that those prices no longer update, how long will it take the scraper to notice? In the mean time, every person who has come to use the scrapers site will be getting false information. And whether those prices are lower or higher, SCG will come out looking like the bad guy.
4- And thats where things can get really sticky. If you scrape someones data and advertise it as such and then the data ends up being false and causes monetary OR reputational damage to the site you scraped, you are committing Libel.
Terms and Service agreements aside, disputing a Libel case is going to cost anyone a whole lot of money. and they are likely to lose it. How can you prove you didn’t damage someones reputation? Just look at how upset people are getting at StarCityGames for sending a cease and desist! There are already people saying they will no longer shop there over this. Just because they tried to stop an uncontrolled use of their reputation and name, they are losing customers. That isn’t fair. I’d be right pissed if I was forced into that situation. Where just by standing up for myself I am cast as the bad guy.
I think that jeopardize the SCG model, well basically you could see in their prices which card would they use at the protour one day before.
I think they use a lot of expert to be able ot find the cards and build the metagame before any one else.
Just look at their previous accomplishmets with this:
Aristocrats SCG
Blue devotion SCG
Zombie legacy.
Chandra in Jund
Well that’s what I can recall.
I believe their business model is having the info before everyone and putting it all together in other place would tamper their way to make profit.