Pages: 1 2 3 4 :: [one page] |
|
Author |
Thread Statistics | Show CCP posts - 24 post(s) |
virm pasuul
Mine 'N' Refine Yulai Federation
162
|
Posted - 2014.10.17 13:07:00 -
[1] - Quote
Just being curious. How big in Gb is Tranquility please? I'm guessing big :) |
Doc Fury
Furious Enterprises
6846
|
Posted - 2014.10.17 13:10:00 -
[2] - Quote
It's as big as a baby Ren!
The accumulated filth of all their sex and murder will foam up about their waists and all the ho's and politicians will look up and shout 'Save us!' and I'll look down, and whisper 'Hodor'. |
Ramona McCandless
The McCandless Clan
7025
|
Posted - 2014.10.17 13:11:00 -
[3] - Quote
Its not as big as a Texan Bar "Many have joined the battle, many have survived the tests and trials, but countless have fallen because they weren't the sharpest, the fastest thinking, the most devious, the most ruthless or most intelligent. -áLog in and Compete!"-á- CCP Falcon
|
Hengle Teron
I'm So Meta Even This Acronym
2587
|
Posted - 2014.10.17 14:19:00 -
[4] - Quote
Can you tell me that in cubic meters? please ! |
Erin Crawford
307
|
Posted - 2014.10.17 14:29:00 -
[5] - Quote
as big as a Fedo's bottom! |
Guttripper
State War Academy Caldari State
556
|
Posted - 2014.10.17 15:45:00 -
[6] - Quote
Definitely smaller than most male teenager's pornography collection... |
The Forum Alt
Hedion University Amarr Empire
42
|
Posted - 2014.10.17 16:08:00 -
[7] - Quote
I have it on good authority that the size of the database is smaller than 1000 petabytes but bigger than 1 byte. |
|
Chribba
Otherworld Enterprises Otherworld Empire
13027
|
Posted - 2014.10.17 16:20:00 -
[8] - Quote
Last time I heard it was a few TB, that was some years ago, so with Jita's daily market transactions I would guess 10x the size now.
/c
|
|
Unsuccessful At Everything
The Troll Bridge
17147
|
Posted - 2014.10.17 16:23:00 -
[9] - Quote
Im sure the database is the same size in Great Britain as it would be anywhere else in the world.
Since the cessation of their usefulness is imminent, may I appropriate your belongings? |
|
CCP DeNormalized
C C P C C P Alliance
18
|
Posted - 2014.10.17 16:24:00 -
[10] - Quote
DB is currently around 2.8 TB, 2 weeks ago it was 3 TB...
We do routine archiving to pull old log records, etc... out to separate databases in an attempt to run as lean as possible.
We also have difference services (sso/vgs/images) in different DB's, so while the core DB itself is around 2 TB (2.8 w/ free space in files for growth), the entire stack is closer to 5-6 TB total. CCP DeNormalized DBA Virtual World Operations |
|
|
|
Chribba
Otherworld Enterprises Otherworld Empire
13028
|
Posted - 2014.10.17 16:26:00 -
[11] - Quote
CCP DeNormalized wrote:DB is currently around 2.8 TB, 2 weeks ago it was 3 TB...
We do routine archiving to pull old log records, etc... out to separate databases in an attempt to run as lean as possible.
We also have difference services (sso/vgs/images) in different DB's, so while the core DB itself is around 2 TB (2.8 w/ free space in files for growth), the entire stack is closer to 5-6 TB total. So that's why you're not letting me read mails further back than a month Stop purging and give me my mails back!
|
|
|
CCP DeNormalized
C C P C C P Alliance
20
|
Posted - 2014.10.17 16:28:00 -
[12] - Quote
Chribba wrote:Last time I heard it was a few TB, that was some years ago, so with Jita's daily market transactions I would guess 10x the size now.
/c
Over the course of the last year, the market tables have grown by about 500 GB :) CCP DeNormalized DBA Virtual World Operations |
|
|
ISD LackOfFaith
ISD Community Communications Liaisons
1757
|
Posted - 2014.10.17 16:47:00 -
[13] - Quote
Disclaimer: what follows is a nerd's best guess, not any official figures from CCP.
TL;DR: Roughly 3.5 TB (3500 GB) of data for strictly describing the universe and stuff running. Roughly 100 TB (100000 GB) for total storage across all of TQ. See below for full details.
A MySQL dump of the static database (item types, solar systems, orbital objects, etc) is around 300 MB.
Total so far: 300 MB
The Community Toolkit downloads for Types, Renders, and Icons are an extra 600 MB or so, zipped. Unzipped at a conservative 50% compression rate, that's 1.2 GB of data just for various static images.
Total so far: 1.5 GB
While we're assuming all static data is also part of the database, we can add the size of a regular install too; say, 10 GB.
Total so far: 11.5 GB
Somewhat less dynamic are character portraits, each of which are saved in varying sizes, from 1024x1024 JPGs down to 32x32 JPG icons. Based on my own portrait, i'm going to estimate the total per-character of these is 250 KB. In 2013, Eve reached "over 500,000 subscribers". Assuming an average of 2.5 characters per account (not everyone uses all 3 slots, but many do), that's 1,250,000 characters. That means 312.5 GB in just character portraits.
Total so far: 324 GB
Of course, that's active subscriptions. How many trial players (or player alts) started accounts that are now inactive? Eve is a pretty rough niche game, so let's say there are 1,500,000 of those. That's another 375 GB of portraits.
Total so far: 699 GB
Now, let's look at ships. The 10 year commemoration video estimates 40,000,000 ships lost. Let's add another 5,000,000 for a violent year. Assuming the number of ships lost per day has been going up linearly since the game's launch (it hasn't, but let's assume), that means that after the (roughly) 4200 days of Eve's lifespan, we're getting about 21,000 lost ships per day. Every time you lose a ship, how many more do you have sitting around? I have no access to those stats, and no idea where to get them, but I'm going to ballpark 10 for the average. 10 ships per 1,250,000 active character is 12,500,000 ships. Add one noobship for every inactive account and you get 14,000,000 ships.
Each ship has a bunch (20-30) of attributes associated with it. Each of those is a 64-bit (8 byte) integer value. 25 attributes per ship, with 8 bytes per attribute and 14,000,000 ships, that's 2.8 GB of data.
Total so far: 702 GB (note: I have only considered assembled ships so far)
But many of those ships have modules fit to them! Let's estimate 8 modules/rigs fit per ship. Each one of those also has a bunch of attributes, and blah blah blah... another 1 GB of stuff.
Total so far: 703 GB
What about other items? Well... Eve-central has a 200 MB gzipped market dump for every day. I'm not going to bother downloading and unzipping those, and call it 1 GB per day. If that's the data size of just the items being traded, how much stuff is there in game? How many buy/sell orders does the average character have going at any one time, compared to their items? Well, no more than 5, unless they have trading skills trained (few non-dedicated traders do). Let's just call it 5 orders. Eve players are pack rats and keep lots of stuff scattered all around the universe. I just checked and it looks like I have many thousands of things scattered about. Though, compensating for alts and new players, I'm going to ballpark 2,000 items (stacks of things) average per character. That means that on average, players have 500 item more items than they do market orders. If an item takes roughly the same amount of data to store, then that's 500 GB of data about peoples' stuff. Plus 1 GB of the actual current orders.
Total so far: 1,304 GB
What about stateful stuff in space? NPCs? Drones? Wrecks? Corpses? Large collidable objects? Asteroids? Mission structures? Wormholes? POSes? Player outposts? Mobile depots? Bubbles? This number is extremely hard to gauge because many of these aren't simple items. They all have positional data, and probably a variety of extra stuff stored server-side to make them work. Their number also varies wildly from system to system. I'm not sure how to approach it, but I'm going to ballpark that it takes multiple times the space it takes to store peoples' stuff (which is relatively static and boring). Let's call it just under 3x, so 2,000 GB.
Total so far: 3,304 GB
You could add logs and other non-critical data to make it an even 3.5 TB.
I can't think of anything else that needs storing, and at this point I've done so much estimation that the answer may be off by quite a lot.
Still... 3.5 TB is not that much, is it? I mean, on Newegg, a 2 TB solid state drive costs just $3300. For about $6000-7000 you could store all of Eve's data on a very fast drive, right?
Well... not so much. Eve is a big place, and a single SSD has no way to keep up with how intensely it would have to be used if it served as the central repository. Also, can you imagine what would happen if the drive broke? You would need extensive replication of all that data both for performance and for backup purposes. On top of that, remember that Tranquility is distributed across 60 (?) nodes, each with a local copy of high-demand data (your ships and stuff in space) plus other cached data.
Considering all the duplication of data necessary to have a system as robust as TQ (yeah, don't laugh, TQ is amazingly robust for what it is), I would estimate there to be something on the order of 100 TB of data floating around in storage between all the machines in TQ put together. Maybe a bit less. Maybe a bit more. Who knows, I don't work there.
Hope this helps! ISD LackOfFaith Captain Community Communication Liaisons (CCLs) Interstellar Services Department I do not respond to Eve Mail or anything other than the forums. |
|
TheMercenaryKing
StarFleet Enterprises Intrepid Crossing
294
|
Posted - 2014.10.17 16:47:00 -
[14] - Quote
CCP DeNormalized wrote:DB is currently around 2.8 TB, 2 weeks ago it was 3 TB...
We do routine archiving to pull old log records, etc... out to separate databases in an attempt to run as lean as possible.
We also have difference services (sso/vgs/images) in different DB's, so while the core DB itself is around 2 TB (2.8 w/ free space in files for growth), the entire stack is closer to 5-6 TB total.
How often do you backup the servers? Daily via deduplication?
I can't imagine your RAID setup so the throughput must be pretty good for all the transactions. SSDs or a lot of 15K drives? 15k drives have about 175 IOPS at 4K block size i think. I doubt you are using 4K, probably another block size for optimization. |
Bienator II
madmen of the skies
2898
|
Posted - 2014.10.17 16:49:00 -
[15] - Quote
* stacked his loot to make the DB smaller eve style bounties (done) dust boarding parties imagine there is war and everybody cloaks - join FW |
|
CCP DeNormalized
C C P C C P Alliance
21
|
Posted - 2014.10.17 16:59:00 -
[16] - Quote
ISD LackOfFaith wrote:Disclaimer: what follows is a nerd's best guess, not any official figures from CCP.
TL;DR: Roughly 3.5 TB (3500 GB) of data for strictly describing the universe and stuff running. Roughly 100 TB (100000 GB) for total storage across all of TQ. See below for full details.
Great effort LoF!
As mentioned, the core DB is 2.8 TB currently, and the image DB is around 1.3 TB.
the inventory system takes up about 250 GB (a single table w/ 2-3 indexes) the market system takes up around 300 GB (2-3 tables and multiple indexes) in-game mail system is around 300 GB as well (we delete most of chribba's mail just to annoy him :))
CCP DeNormalized DBA Virtual World Operations |
|
|
CCP DeNormalized
C C P C C P Alliance
22
|
Posted - 2014.10.17 17:08:00 -
[17] - Quote
TheMercenaryKing wrote:
How often do you backup the servers? Daily via deduplication?
I can't imagine your RAID setup so the throughput must be pretty good for all the transactions. SSDs or a lot of 15K drives? 15k drives have about 175 IOPS at 4K block size i think. I doubt you are using 4K, probably another block size for optimization.
DB is split across 2 tiers of storage, SSD (enterprise level intel disks in v7000 enclosures) for the heavily accessed stuff and 15k SAS disks for the second 'slower' tier.
I'm not that knowledgeable abuot the SAN side and how the block sizes are handed there, but as the LUN's are given to us, we setup our volumes @ 64K block size as this is the optimal allocation for SQL (64k = 1 extent = 8x8KB pages)
We do 2 full backups per day (written across 8 files for disk melting IO dumps) which take a little over 1 hour each... Hits the disks for around 400 MB/s
CCP DeNormalized DBA Virtual World Operations |
|
MiliasColds
The Elite Few Inc. The Methodical Alliance
21
|
Posted - 2014.10.17 17:09:00 -
[18] - Quote
it's not on an SSD it's on RAMSAN AFAIK, so think more like 100k / TB (i think) but hey it's super super fast :P
edi: seems i was wrong and beaten to the punch by 1s |
virm pasuul
Mine 'N' Refine Yulai Federation
164
|
Posted - 2014.10.17 17:09:00 -
[19] - Quote
TY DeNormalized, and thank you for caring for our sandpit. |
|
CCP DeNormalized
C C P C C P Alliance
22
|
Posted - 2014.10.17 17:12:00 -
[20] - Quote
MiliasColds wrote:it's not on an SSD it's on RAMSAN AFAIK, so think more like 100k / TB (i think) but hey it's super super fast :P
edi: seems i was wrong and beaten to the punch by 1s
We used to run on the RamSan's but stopped about 3 years ago. They were completely overkill for our needs and at the time expanding was rather difficult.
We had 3 units, 2x 128 GB pure flashbased units and sometime later added a third 2 TB array (this wasn't flash based if I remember).
CCP DeNormalized DBA Virtual World Operations |
|
|
MiliasColds
The Elite Few Inc. The Methodical Alliance
21
|
Posted - 2014.10.17 17:18:00 -
[21] - Quote
CCP DeNormalized wrote:MiliasColds wrote:it's not on an SSD it's on RAMSAN AFAIK, so think more like 100k / TB (i think) but hey it's super super fast :P
edi: seems i was wrong and beaten to the punch by 1s We used to run on the RamSan's but stopped about 3 years ago. They were completely overkill for our needs and at the time expanding was rather difficult. We had 3 units, 2x 128 GB pure flashbased units and sometime later added a third 2 TB array (this wasn't flash based if I remember).
least i wasn't just horribly misinformed, simply out of date :), but dat 1M randon IOPS /s :P |
virm pasuul
Mine 'N' Refine Yulai Federation
164
|
Posted - 2014.10.17 17:18:00 -
[22] - Quote
I've recently started to look after a work database that's 24Gb and growing by 100Mbish per day. It's a tiny drop in the ocean compared to Eve but I keep looking at it and thinking "How can I stop it growing?" I am considering turning the users off because they are spoiling my database. |
Hengle Teron
I'm So Meta Even This Acronym
2587
|
Posted - 2014.10.17 17:25:00 -
[23] - Quote
CCP DeNormalized wrote:ISD LackOfFaith wrote:Disclaimer: what follows is a nerd's best guess, not any official figures from CCP.
TL;DR: Roughly 3.5 TB (3500 GB) of data for strictly describing the universe and stuff running. Roughly 100 TB (100000 GB) for total storage across all of TQ. See below for full details.
Great effort LoF! As mentioned, the core DB is 2.8 TB currently, and the image DB is around 1.3 TB. the inventory system takes up about 250 GB (a single table w/ 2-3 indexes) the market system takes up around 300 GB (2-3 tables and multiple indexes) in-game mail system is around 300 GB as well (we delete most of chribba's mail just to annoy him :)) ok, but how much is that in cubic meters... ? |
Adrie Atticus
Shadows of Rebellion The Bastion
439
|
Posted - 2014.10.17 17:38:00 -
[24] - Quote
Hengle Teron wrote:CCP DeNormalized wrote:ISD LackOfFaith wrote:Disclaimer: what follows is a nerd's best guess, not any official figures from CCP.
TL;DR: Roughly 3.5 TB (3500 GB) of data for strictly describing the universe and stuff running. Roughly 100 TB (100000 GB) for total storage across all of TQ. See below for full details.
Great effort LoF! As mentioned, the core DB is 2.8 TB currently, and the image DB is around 1.3 TB. the inventory system takes up about 250 GB (a single table w/ 2-3 indexes) the market system takes up around 300 GB (2-3 tables and multiple indexes) in-game mail system is around 300 GB as well (we delete most of chribba's mail just to annoy him :)) ok, but how much is that in cubic meters... ?
0.02 m3 per module, not sure how many, but I'd guess it's a full rack; 1.43 m3 per full 42U rack. |
|
ISD LackOfFaith
ISD Community Communications Liaisons
1760
|
Posted - 2014.10.17 17:40:00 -
[25] - Quote
CCP DeNormalized wrote:ISD LackOfFaith wrote:Disclaimer: what follows is a nerd's best guess, not any official figures from CCP.
TL;DR: Roughly 3.5 TB (3500 GB) of data for strictly describing the universe and stuff running. Roughly 100 TB (100000 GB) for total storage across all of TQ. See below for full details.
Great effort LoF! As mentioned, the core DB is 2.8 TB currently, and the image DB is around 1.3 TB. the inventory system takes up about 250 GB (a single table w/ 2-3 indexes) the market system takes up around 300 GB (2-3 tables and multiple indexes) in-game mail system is around 300 GB as well (we delete most of chribba's mail just to annoy him :)) Woo! Hooray ballparking!
Also, I completely forgot about the mail system, oops. ISD LackOfFaith Captain Community Communication Liaisons (CCLs) Interstellar Services Department I do not respond to Eve Mail or anything other than the forums. |
|
|
CCP DeNormalized
C C P C C P Alliance
26
|
Posted - 2014.10.17 17:44:00 -
[26] - Quote
virm pasuul wrote:I've recently started to look after a work database that's 24Gb and growing by 100Mbish per day. It's a tiny drop in the ocean compared to Eve but I keep looking at it and thinking "How can I stop it growing?" I am considering turning the users off because they are spoiling my database.
we discuss similar things :)
An on-going project is trimming the market orders table - we tried to talk the game designers into just letting us truncate the table but they wanted no part of it :) CCP DeNormalized DBA Virtual World Operations |
|
Chainsaw Plankton
IDLE GUNS IDLE EMPIRE
708
|
Posted - 2014.10.17 17:46:00 -
[27] - Quote
CCP DeNormalized wrote:MiliasColds wrote:it's not on an SSD it's on RAMSAN AFAIK, so think more like 100k / TB (i think) but hey it's super super fast :P
edi: seems i was wrong and beaten to the punch by 1s We used to run on the RamSan's but stopped about 3 years ago. They were completely overkill for our needs and at the time expanding was rather difficult. We had 3 units, 2x 128 GB pure flashbased units and sometime later added a third 2 TB array (this wasn't flash based if I remember).
I remember seeing something about the Ramsan in a devblog a while back. all i know is thing sounded shiny I'll join the chorus asking CCP, don't take my fancy names away from me! In the name of the Limos, the Malkuth, and the Arbalest, so help me pod - Mara Rinn |
virm pasuul
Mine 'N' Refine Yulai Federation
165
|
Posted - 2014.10.17 17:55:00 -
[28] - Quote
CCP DeNormalized wrote:virm pasuul wrote:I've recently started to look after a work database that's 24Gb and growing by 100Mbish per day. It's a tiny drop in the ocean compared to Eve but I keep looking at it and thinking "How can I stop it growing?" I am considering turning the users off because they are spoiling my database. we discuss similar things :) An on-going project is trimming the market orders table - we tried to talk the game designers into just letting us truncate the table but they wanted no part of it :)
Make everything on the market a fixed price, then the table will become much smaller. Seems a good compromise to me :) |
Caviar Liberta
Moira. Villore Accords
722
|
Posted - 2014.10.17 17:57:00 -
[29] - Quote
TheMercenaryKing wrote:CCP DeNormalized wrote:DB is currently around 2.8 TB, 2 weeks ago it was 3 TB...
We do routine archiving to pull old log records, etc... out to separate databases in an attempt to run as lean as possible.
We also have difference services (sso/vgs/images) in different DB's, so while the core DB itself is around 2 TB (2.8 w/ free space in files for growth), the entire stack is closer to 5-6 TB total. How often do you backup the servers? Daily via deduplication? I can't imagine your RAID setup so the throughput must be pretty good for all the transactions. SSDs or a lot of 15K drives? 15k drives have about 175 IOPS at 4K block size i think. I doubt you are using 4K, probably another block size for optimization.
The intial back up would be the most time consuming. Setting up the back to only copy any files that has been changed or added would make the task a lot easier then. |
|
CCP DeNormalized
C C P C C P Alliance
32
|
Posted - 2014.10.17 18:02:00 -
[30] - Quote
Caviar Liberta wrote:TheMercenaryKing wrote:CCP DeNormalized wrote:DB is currently around 2.8 TB, 2 weeks ago it was 3 TB...
We do routine archiving to pull old log records, etc... out to separate databases in an attempt to run as lean as possible.
We also have difference services (sso/vgs/images) in different DB's, so while the core DB itself is around 2 TB (2.8 w/ free space in files for growth), the entire stack is closer to 5-6 TB total. How often do you backup the servers? Daily via deduplication? I can't imagine your RAID setup so the throughput must be pretty good for all the transactions. SSDs or a lot of 15K drives? 15k drives have about 175 IOPS at 4K block size i think. I doubt you are using 4K, probably another block size for optimization. The intial back up would be the most time consuming. Setting up the back to only copy any files that has been changed or added would make the task a lot easier then.
we do different things w/ each backup - the secondary one gets shipped to a different server for reporting purposes, but you are correct, a differential would make sense in most cases here CCP DeNormalized DBA Virtual World Operations |
|
|
|
CCP DeNormalized
C C P C C P Alliance
32
|
Posted - 2014.10.17 18:04:00 -
[31] - Quote
virm pasuul wrote:CCP DeNormalized wrote:virm pasuul wrote:I've recently started to look after a work database that's 24Gb and growing by 100Mbish per day. It's a tiny drop in the ocean compared to Eve but I keep looking at it and thinking "How can I stop it growing?" I am considering turning the users off because they are spoiling my database. we discuss similar things :) An on-going project is trimming the market orders table - we tried to talk the game designers into just letting us truncate the table but they wanted no part of it :) Make everything on the market a fixed price, then the table will become much smaller. Seems a good compromise to me :)
In this market order clean up, we noticed that there is one crazy player that has an open order for 7 years now!!!! Any order expires after 90 days unless you update it...
So this player has been modifying this one order, at least once every 90 days, for the last 7 frickin years!! haha
There are 3 items left in his sell order - I wanted to just go buy them so there wouldn't be such a big gap in ID's :)
I got over ruled on that as well
(i sent a mail to community about this guy saying he (or she?) should get some kinda medal, so we'll see what comes of that) CCP DeNormalized DBA Virtual World Operations |
|
Max Kolonko
High Voltage Industries Ash Alliance
464
|
Posted - 2014.10.17 18:08:00 -
[32] - Quote
CCP Denormalized - best CCP name for the job :) Read and support: Don't mess with OUR WH's What is Your stance on WH stuff? |
Jandice Ymladris
Aurora Arcology
943
|
Posted - 2014.10.17 18:13:00 -
[33] - Quote
I love threads like this! Very informative & you learn alot about the technical aspects of EvE (and you get to see some CCP folks that are usually very good at hiding) Sansha fleets raiding deep space facilities! A summary of the ancient civilizations of New Eden |
Gilbaron
Free-Space-Ranger Nulli Secunda
1551
|
Posted - 2014.10.17 18:30:00 -
[34] - Quote
I'm curious about that 7 year old market order. Is it an overpriced sellorder, an underpriced buyorder or an item that nobody ever buys? Build your empire ! Start today ! Rent Space in Perrigen Falls and Feythabolis Contact me for details :)
|
virm pasuul
Mine 'N' Refine Yulai Federation
166
|
Posted - 2014.10.17 18:32:00 -
[35] - Quote
It's gotta be a finger slip order that's hoping to catch a drunken finger slip. The quantity is small and it probably cost a lot to set up - hence the desire not to pay to set it up again. |
Chainsaw Plankton
IDLE GUNS IDLE EMPIRE
709
|
Posted - 2014.10.17 18:36:00 -
[36] - Quote
I don't think I've had a market order last over 180 days, usually after a few weeks of modifying orders I get bored, go do something else, and forget about it I'll join the chorus asking CCP, don't take my fancy names away from me! In the name of the Limos, the Malkuth, and the Arbalest, so help me pod - Mara Rinn |
|
CCP DeNormalized
C C P C C P Alliance
40
|
Posted - 2014.10.17 18:39:00 -
[37] - Quote
it is a sell order, that started with 20 units - 17 sold and 3 left :)
it's only like 1.6 mil per unit and not the highest in the region. CCP DeNormalized DBA Virtual World Operations |
|
Jandice Ymladris
Aurora Arcology
945
|
Posted - 2014.10.17 18:47:00 -
[38] - Quote
CCP DeNormalized wrote:it is a sell order, that started with 20 units - 17 sold and 3 left :)
it's only like 1.6 mil per unit and not the highest in the region.
Must be something very rarely traded then! Or perhaps the creator just likes to see how long he can keep running it... Still, darn impressive lasting that long. Sansha fleets raiding deep space facilities! A summary of the ancient civilizations of New Eden |
virm pasuul
Mine 'N' Refine Yulai Federation
167
|
Posted - 2014.10.17 18:55:00 -
[39] - Quote
Hey DeNormalized when is CCP going to set up a database administrator's player event? We could all drink beer and complain about users touching the database. |
|
CCP DeNormalized
C C P C C P Alliance
44
|
Posted - 2014.10.17 19:07:00 -
[40] - Quote
virm pasuul wrote:Hey DeNormalized when is CCP going to set up a database administrator's player event? We could all drink beer and complain about users touching the database.
It could be the only Eve player event ever where no one was allowed to log onto Eve.
We do it every year @ fanfest during our virtual worlds admin round table/QandA :)
CCP DeNormalized DBA Virtual World Operations |
|
|
virm pasuul
Mine 'N' Refine Yulai Federation
170
|
Posted - 2014.10.17 19:13:00 -
[41] - Quote
I hope to see you there one year. Or at whatever player event Riot organises if I leave it too long :) |
Aryth
GoonWaffe Goonswarm Federation
1632
|
Posted - 2014.10.17 20:11:00 -
[42] - Quote
Matching your OS level blocksize in a good manner to the SAN block size is fairly important. I hope they took your 64K size into account when they laid out the storage. This doesn't always have to perfectly match but it usually does. 64k is kinda an oddball. Would love to know that someone actually ran performance tests with 4/8/16/32/64k blocksizes at both tiers. Leader of the Goonswarm Economic Warfare Cabal. Vile Rat: You're the greatest sociopath that has ever played eve. |
Bienator II
madmen of the skies
2902
|
Posted - 2014.10.17 22:05:00 -
[43] - Quote
CCP DeNormalized wrote: In this market order clean up, we noticed that there is one crazy player that has an open order for 7 years now!!!! Any order expires after 90 days unless you update it...
So this player has been modifying this one order, at least once every 90 days, for the last 7 frickin years!! haha
There are 3 items left in his sell order - I wanted to just go buy them so there wouldn't be such a big gap in ID's :)
I got over ruled on that as well
(i sent a mail to community about this guy saying he (or she?) should get some kinda medal, so we'll see what comes of that)
haha. thats funny. Can't you just cheat and replace his order with a fresh one while he is not looking? We won't tell him. eve style bounties (done) dust boarding parties imagine there is war and everybody cloaks - join FW |
Toriessian
Helion Production Labs Independent Operators Consortium
332
|
Posted - 2014.10.18 02:28:00 -
[44] - Quote
Jandice Ymladris wrote:CCP DeNormalized wrote:it is a sell order, that started with 20 units - 17 sold and 3 left :)
it's only like 1.6 mil per unit and not the highest in the region. Must be something very rarely traded then! Or perhaps the creator just likes to see how long he can keep running it... Still, darn impressive lasting that long.
Its about the right price for synth boosters. |
|
CCP DeNormalized
C C P C C P Alliance
65
|
Posted - 2014.10.18 13:26:00 -
[45] - Quote
Toriessian wrote:Jandice Ymladris wrote:CCP DeNormalized wrote:it is a sell order, that started with 20 units - 17 sold and 3 left :)
it's only like 1.6 mil per unit and not the highest in the region. Must be something very rarely traded then! Or perhaps the creator just likes to see how long he can keep running it... Still, darn impressive lasting that long. Its about the right price for synth boosters.
Perhaps, but this isn't those!! :) CCP DeNormalized DBA Virtual World Operations |
|
Mr M
Sebiestor Tribe
415
|
Posted - 2014.10.18 14:09:00 -
[46] - Quote
CCP DeNormalized wrote:DB is currently around 2.8 TB, 2 weeks ago it was 3 TB...
How much of the database is tritanium?
|
Francis Inch
Aegis Cartel The G0dfathers
4
|
Posted - 2014.10.18 16:23:00 -
[47] - Quote
I just found my new favourite Dev. |
Sakurako Kimino
Eternal Darkness. Get Off My Lawn
16
|
Posted - 2014.10.18 21:54:00 -
[48] - Quote
CCP DeNormalized wrote:Toriessian wrote:Jandice Ymladris wrote:CCP DeNormalized wrote:it is a sell order, that started with 20 units - 17 sold and 3 left :)
it's only like 1.6 mil per unit and not the highest in the region. Must be something very rarely traded then! Or perhaps the creator just likes to see how long he can keep running it... Still, darn impressive lasting that long. Its about the right price for synth boosters. Perhaps, but this isn't those!! :)
if you tell us the item we might buy them out lol
eve is about sin |
flakeys
Arkham Innovations
2551
|
Posted - 2014.10.18 22:17:00 -
[49] - Quote
It's more then that.
We are all born ignorant, but one must work hard to remain stupid.
|
Sven Viko VIkolander
Friends and Feminists
288
|
Posted - 2014.10.19 03:37:00 -
[50] - Quote
CCP DeNormalized wrote:it is a sell order, that started with 20 units - 17 sold and 3 left :)
it's only like 1.6 mil per unit and not the highest in the region.
This should be like a treasure hunt, where we go and try to find this item. Since there's not much isk to be made on a 1.6m item I would guess that this is in null and is maybe a cyno generator, on the market for availability in the region and not for making isk. That's my guess anyhow, as any other explanation seems completely irrational lol.. |
|
Serene Repose
1548
|
Posted - 2014.10.19 05:30:00 -
[51] - Quote
So. not as big as LackOfFaith's post...give or take. I have sworn upon the altar of God eternal hostility toward every form of tyranny over the mind of man.-á |
Rakshasa Taisab
Sane Industries Inc.
1614
|
Posted - 2014.10.19 11:31:00 -
[52] - Quote
CCP should send a concerned citizen report to the local authorities so that mental health professionals can check in on that guy. Nyan |
|
CCP DeNormalized
C C P C C P Alliance
86
|
Posted - 2014.10.19 12:24:00 -
[53] - Quote
Sven Viko VIkolander wrote:CCP DeNormalized wrote:it is a sell order, that started with 20 units - 17 sold and 3 left :)
it's only like 1.6 mil per unit and not the highest in the region. This should be like a treasure hunt, where we go and try to find this item. Since there's not much isk to be made on a 1.6m item I would guess that this is in null and is maybe a cyno generator, on the market for availability in the region and not for making isk. That's my guess anyhow, as any other explanation seems completely irrational lol..
I passed the info onto community in hopes something like might happen :) But we'll see how they wanna handle it. CCP DeNormalized DBA Virtual World Operations |
|
|
CCP DeNormalized
C C P C C P Alliance
86
|
Posted - 2014.10.19 12:26:00 -
[54] - Quote
Rakshasa Taisab wrote:CCP should send a concerned citizen report to the local authorities so that mental health professionals can check in on that guy.
I'm in a little more cynical :)
I also passed it onto security so they could check if it was some long forgotten about market bot sitting in someones closet praying for someone to buy the damn things so it could end itself :) CCP DeNormalized DBA Virtual World Operations |
|
Arec Bardwin
1562
|
Posted - 2014.10.19 12:35:00 -
[55] - Quote
17/20 items at 1.6 mill sold in 7 years? Imagine the huge profit on that market order!
This is friggin hilarious! |
Jandice Ymladris
Aurora Arcology
953
|
Posted - 2014.10.19 12:41:00 -
[56] - Quote
CCP DeNormalized wrote: some long forgotten about market bot sitting in someones closet praying for someone to buy the damn things so it could end itself :)
A lone old marketbot sits on some big traders client... all obsolete, it's purpose lost, save for one last trade-order. For years it's been keeping it up, adjusting it's price, to make it last, this one last & sole reason for it's abandoned existence. It wants it to end, for 7 years it's been toiling with it's lonely market-order, all forgotten, not only by it's master, the Trader, but also by the denizens of Eve, who just pass by it's order, only buying something once in a blue moon... fuelling the poor bot's delusion that eternal rest is there, and yet it is denied, just beyond it's grasp as the buyer elaves, and the order goes on, untouched, save for the small manipulation of the old market-bot to keep itself and it's lonely order in existence. 3 items to go, and then eternal rest awaits, the bliss of nothingness... no more markets, no more Eve... no more a forgotten existence, toiling with this one lonely forgotten order... *Buy this item* it says; *save me from my existence of nothingness* it cries... but the only answer is silence.... The result of the YC116 Sleeper data research race! A summary of the ancient civilizations of New Eden |
Arec Bardwin
1562
|
Posted - 2014.10.19 12:47:00 -
[57] - Quote
Beautiful. |
Styledatol
Future Corps Sleeper Social Club
66
|
Posted - 2014.10.19 14:20:00 -
[58] - Quote
I shed a tear... |
Gospadin
School of Applied Knowledge Caldari State
225
|
Posted - 2014.10.19 17:41:00 -
[59] - Quote
Jandice Ymladris wrote:CCP DeNormalized wrote: some long forgotten about market bot sitting in someones closet praying for someone to buy the damn things so it could end itself :) A lone old marketbot sits on some big traders client... all obsolete, it's purpose lost, save for one last trade-order. For years it's been keeping it up, adjusting its price, to make it last, this one last & sole reason for its abandoned existence. It wants it to end, for 7 years it's been toiling with this lonely market-order, all forgotten, not only by its master, the Trader, but also by the denizens of Eve, who just pass by the market-order, only buying something once in a blue moon... fueling the poor bot's delusion that eternal rest is there, and yet it is denied, just beyond its grasp as the buyer leaves, and the order goes on, untouched for months once again, save for the small manipulation of the old market-bot to keep itself and its lonely order in existence. 3 items to go, and then eternal rest awaits, the bliss of nothingness... no more markets, no more Eve... no more a forgotten existence, toiling with this one lonely forgotten order... *Buy this item* it says; *save me from my existence of nothingness* it cries... but the only answer is silence.... And the database ticks on... the bot's trade-order standing out oddly with its strange, outdated ID-number.... a lone testimony to its endurance & solitude....
+1
reminded me a bit of Asimov's "The Last Question"
http://www.multivax.com/last_question.html |
Jandice Ymladris
Aurora Arcology
965
|
Posted - 2014.10.19 18:15:00 -
[60] - Quote
Wow seems alot of folks enjoyed my inspirational flash. Glad to hear so many like it! All the info CCP DeNormalized released about this marketorder made it felt so tragic, and then he came up with the thought of a marketbot and it just all fell in place!
Neat! I'm a fan of Isaac Asimov's writings, but never read this short story until now. Cheers for linking it!
Also, this thread's the best, has it all, from technical info on how the server deals with data to CCP generating content & players acting on it (the market order!)
Best to go back to the thread, would hate to see it locked for derailment I wonder how much data our assets are occupying on the server? As unlike other MMO's, we can have stuff everywhere indefinatly, so I suspect it would be a big drain on data storage? Or not really as it's more static? The result of the YC116 Sleeper data research race! A summary of the ancient civilizations of New Eden |
|
Luscius Uta
109
|
Posted - 2014.10.19 19:52:00 -
[61] - Quote
CCP DeNormalized wrote:virm pasuul wrote:CCP DeNormalized wrote:virm pasuul wrote:I've recently started to look after a work database that's 24Gb and growing by 100Mbish per day. It's a tiny drop in the ocean compared to Eve but I keep looking at it and thinking "How can I stop it growing?" I am considering turning the users off because they are spoiling my database. we discuss similar things :) An on-going project is trimming the market orders table - we tried to talk the game designers into just letting us truncate the table but they wanted no part of it :) Make everything on the market a fixed price, then the table will become much smaller. Seems a good compromise to me :) In this market order clean up, we noticed that there is one crazy player that has an open order for 7 years now!!!! Any order expires after 90 days unless you update it... So this player has been modifying this one order, at least once every 90 days, for the last 7 frickin years!! haha There are 3 items left in his sell order - I wanted to just go buy them so there wouldn't be such a big gap in ID's :) I got over ruled on that as well (i sent a mail to community about this guy saying he (or she?) should get some kinda medal, so we'll see what comes of that)
The only reason why EVE needs achievements
People hate highsec for various reasons. Mine is the terrible metallic music that plays on and on. |
|
CCP DeNormalized
C C P C C P Alliance
104
|
Posted - 2014.10.19 22:04:00 -
[62] - Quote
Jandice Ymladris wrote: I wonder how much data our assets are occupying on the server? As unlike other MMO's, we can have stuff everywhere indefinatly, so I suspect it would be a big drain on data storage? Or not really as it's more static?
the inventory system is around 250 GB - this includes multiple indexes on the same data though so we (or you) can access it faster, etc...
every item/stack per location has a unique row in the DB, for a total of around 2.2 billion rows at the moment :)
CCP DeNormalized DBA Virtual World Operations |
|
Tzeentchful Nakrar
Dixon Cox Butte Preservation Society Black Legion.
0
|
Posted - 2014.10.20 01:59:00 -
[63] - Quote
CCP DeNormalized wrote:Jandice Ymladris wrote: I wonder how much data our assets are occupying on the server? As unlike other MMO's, we can have stuff everywhere indefinatly, so I suspect it would be a big drain on data storage? Or not really as it's more static?
the inventory system is around 250 GB - this includes multiple indexes on the same data though so we (or you) can access it faster, etc... every item/stack per location has a unique row in the DB, for a total of around 2.2 billion rows at the moment :) That is a lot of rows. You guys must have some really insane servers to serve that amount of data at the seed you do. I do have a quick question. What is the oldest item a players has? |
Bienator II
madmen of the skies
2906
|
Posted - 2014.10.20 03:59:00 -
[64] - Quote
i am wondering if the DB would be still useable when every item in eve would be unstacked. Since if it would ... can we pretty please have manufacturer info and other metadata for items? ;) eve style bounties (done) dust boarding parties imagine there is war and everybody cloaks - join FW |
Max Kolonko
High Voltage Industries Ash Alliance
471
|
Posted - 2014.10.20 05:56:00 -
[65] - Quote
Bienator II wrote:i am wondering if the DB would be still useable when every item in eve would be unstacked. Since if it would ... can we pretty please have manufacturer info and other metadata for items? ;)
that trit Read and support: Don't mess with OUR WH's What is Your stance on WH stuff? |
WhyYouHeffToBeMad IsOnlyGame
Republic Military School Minmatar Republic
214
|
Posted - 2014.10.20 08:27:00 -
[66] - Quote
Sakurako Kimino wrote:CCP DeNormalized wrote:Toriessian wrote:Jandice Ymladris wrote:CCP DeNormalized wrote:it is a sell order, that started with 20 units - 17 sold and 3 left :)
it's only like 1.6 mil per unit and not the highest in the region. Must be something very rarely traded then! Or perhaps the creator just likes to see how long he can keep running it... Still, darn impressive lasting that long. Its about the right price for synth boosters. Perhaps, but this isn't those!! :) if you tell us the item we might buy them out lol that is why he doesn't want to tell which item it is so to not ruin the EVE record for the longest ongoing sell order. A.K.A Hodor Von Grootenberg |
Varisto
North Star Science And Industry
4
|
Posted - 2014.10.20 08:34:00 -
[67] - Quote
So you run on SSD that database? Now in curious how long does it take you to kill one drive? SSD dont usually like very much on constantly changing data... |
|
CCP DeNormalized
C C P C C P Alliance
114
|
Posted - 2014.10.20 10:28:00 -
[68] - Quote
Varisto wrote:So you run on SSD that database? Now in curious how long does it take you to kill one drive? SSD dont usually like very much on constantly changing data...
I've asked our SAN guys that very question in the past :)
They say upwards of 5 year life span depending on how many writes, etc... keep in mind these are enterprise grade SSD's (with the insane prices to boot) and have extra 'stuff' to keep them alive longer :)
100% moar stuff!!! yeaaa!!!! hehe
We've yet to lose one, but I believe we're getting close to end of life and may likely replace in the coming year or so.
CCP DeNormalized DBA Virtual World Operations |
|
|
CCP DeNormalized
C C P C C P Alliance
114
|
Posted - 2014.10.20 10:40:00 -
[69] - Quote
Tzeentchful Nakrar wrote: That is a lot of rows. You guys must have some really insane servers to serve that amount of data at the seed you do. I do have a quick question. What is the oldest item a players has?
The most insane part of our DB is ram IMO - we're running 512 GB of ram, so it's able to pull a tremendous amount of data into memory and that gives us great speed.
That much RAM coupled with fast SSD's (and properly indexed data) and you can do quite a bit :)
In terms of oldest item, it's a very difficult thing to find. Up until 4 years ago or so, we were recycling ID's (32 bit) so we are really able to say beyond that.
Now we use 64 bit and can trace how old items are, but I think it's fair to say that there are items in hangars from the beginning :) CCP DeNormalized DBA Virtual World Operations |
|
Johan Civire
The Lyran Empire
867
|
Posted - 2014.10.20 11:09:00 -
[70] - Quote
This is good reading stuff :D i like it. But about that order can we have a name or what do he or she sells or is that forbidden? i like to know now ? :D |
|
Jandice Ymladris
Aurora Arcology
974
|
Posted - 2014.10.20 11:10:00 -
[71] - Quote
I'm surprised the inventory 'only' takes 259 GB of space, considering we tend to litter stuff everywhere as our characters age (I admit I'm terrible at it, think my asset list expands over a hundred stations....) So sounds like a pretty efficient system you got (I guess it helps that you don't need to 'generate' a history for the items as well, at least the ones you can stack)
On the other hand 2.2 billion rows, and one row per item/stack per location, that's one humongous list.... Albeit I presume this includes inactive accounts as well.
That ram tho... 512 GB! That just boggles my mind. Makes me wonder what amounts of ram you normally see to run servers? Or is this big amount an EvE thing to keep it a one shard thing? The result of the YC116 Sleeper data research race: Tech 3 Destroyers! A summary of the ancient civilizations of New Eden |
Max Kolonko
High Voltage Industries Ash Alliance
474
|
Posted - 2014.10.20 11:21:00 -
[72] - Quote
Jandice Ymladris wrote:
That ram tho... 512 GB! That just boggles my mind. Makes me wonder what amounts of ram you normally see to run servers? Or is this big amount an EvE thing to keep it a one shard thing?
Rams going into hundreds or thousands of gigs for dedicated database clusters are slowly becoming standard for large databases. I think google was one of the first to utilize it in their hadoop design.
Read and support: Don't mess with OUR WH's What is Your stance on WH stuff? |
Hengle Teron
I'm So Meta Even This Acronym
2591
|
Posted - 2014.10.20 11:22:00 -
[73] - Quote
CCP DeNormalized wrote:
The most insane part of our DB is ram IMO - we're running 512 GB of ram, so it's able to pull a tremendous amount of data into memory and that gives us great speed. :)
Mind blown |
Arline Kley
PIE Inc. Praetoria Imperialis Excubitoris
411
|
Posted - 2014.10.20 11:25:00 -
[74] - Quote
Jandice Ymladris wrote:That ram tho... 512 GB! That just boggles my mind. Makes me wonder what amounts of ram you normally see to run servers? Or is this big amount an EvE thing to keep it a one shard thing?
512GB of RAM is pretty big; the cluster I am running here is something like 120GB RAM for 9 seperate servers (each virtualized) whilst the data is sat on a 8TB SAN running tradtional HDD's. We did try to get SSD's but sadly the costs were prohibitive.
I would give my left arm to work in CCP's datacentre. Blessed are those that carry the Empress' Light; with it they destroy the shadows |
|
CCP DeNormalized
C C P C C P Alliance
119
|
Posted - 2014.10.20 11:25:00 -
[75] - Quote
Johan Civire wrote:This is good reading stuff :D i like it. But about that order can we have a name or what do he or she sells or is that forbidden? i like to know now ? :D
I wouldn't tell, no... community may choose to do something with this info, but if not it'll just be one more mystery of the universe :) CCP DeNormalized DBA Virtual World Operations |
|
Kousaka Otsu Shigure
9
|
Posted - 2014.10.20 11:26:00 -
[76] - Quote
One of my side projects is creating an out-of-game contacts list. Is our ingame contacts list cap somehow related to how the database works?
I'm at ~24k hisec contacts at the moment and i must admit, im such a noob with databases. |
|
CCP DeNormalized
C C P C C P Alliance
119
|
Posted - 2014.10.20 11:43:00 -
[77] - Quote
Kousaka Otsu Shigure wrote:One of my side projects is creating an out-of-game contacts list. Is our ingame contacts list cap somehow related to how the database works?
I'm at ~24k hisec contacts at the moment and i must admit, im such a noob with databases.
In most cases any sort of cap would be done for performance reasons, either due to the DB or the client itself. I can't see the DB being an issue here however.
Mind you, if you were to have 24,000 contacts in-game, i would think the overhead of loading those in the client and doing whatever happens with those, would definitely have a negative impact on client side performance :)
CCP DeNormalized DBA Virtual World Operations |
|
Wacktopia
Noir. Suddenly Spaceships.
711
|
Posted - 2014.10.20 12:46:00 -
[78] - Quote
Chribba wrote:CCP DeNormalized wrote:DB is currently around 2.8 TB, 2 weeks ago it was 3 TB...
We do routine archiving to pull old log records, etc... out to separate databases in an attempt to run as lean as possible.
We also have difference services (sso/vgs/images) in different DB's, so while the core DB itself is around 2 TB (2.8 w/ free space in files for growth), the entire stack is closer to 5-6 TB total. So that's why you're not letting me read mails further back than a month Stop purging and give me my mails back!
See, all the cool kids are deleting their data. :) Kitchen sink? Seriousy, get your ship together - -áFleet-Up.com |
Arcos Vandymion
White Beast Inc.
65
|
Posted - 2014.10.20 14:25:00 -
[79] - Quote
Jandice Ymladris wrote:I'm surprised the inventory 'only' takes 259 GB of space, considering we tend to litter stuff everywhere as our characters age (I admit I'm terrible at it, think my asset list expands over a hundred stations....) So sounds like a pretty efficient system you got (I guess it helps that you don't need to 'generate' a history for the items as well, at least the ones you can stack)
I perferr my cchaos concentrated into one abysmal eye of terror... I did have to rent freighter services a handful of times allready to ferry stuff between stations.
Currently everything is on one station and some assests in null that i can't get sold ...
Regarding the contacts - I recently did a single mission for the majority of corporations in EVE and whenever I open my standings tab now (which really could need nifty little arrows to expand or collapse the tree) it needs a while. Can't imagine what the game would do if you had a lsit of 24k to pull and display. |
Gospadin
School of Applied Knowledge Caldari State
227
|
Posted - 2014.10.20 17:29:00 -
[80] - Quote
Varisto wrote:So you run on SSD that database? Now in curious how long does it take you to kill one drive? SSD dont usually like very much on constantly changing data...
There are essentially no actual field usage models that will burn out the latest generation of enterprise SSDs with 10DWD or above ratings. 10 DWD to an 800GB drive is 100MB/s non-stop for 5 years. In a normal 80/20 read/write workload typical of many databases, essentially the drive will run bus-saturated for the entire warranty duration.
Most people don't understand what a petabyte of data written to a single device looks like, while drives launched a year ago are good for multiple petabytes per drive. Build an array out of them, and you're talking multiple tens of petabytes. That rating accounts for all internal data movement as well, meaning those petabytes are true user petabytes.
|
|
5yndr0m3
Origin. Black Legion.
31
|
Posted - 2014.10.20 19:19:00 -
[81] - Quote
ISD LackOfFaith wrote:[b]Disclaimer: what follows is a nerd's best guess,
Hope this helps!
Proving once again ISD dont read the threads before they post/lock them.
|
5yndr0m3
Origin. Black Legion.
31
|
Posted - 2014.10.20 19:19:25 -
[82] - Quote
ISD LackOfFaith wrote:[b]Disclaimer: what follows is a nerd's best guess,
Hope this helps!
Proving once again ISD dont read the threads before they post/lock them.
|
Arline Kley
PIE Inc. Praetoria Imperialis Excubitoris
412
|
Posted - 2014.10.20 22:15:00 -
[83] - Quote
Jandice Ymladris wrote:that feels story.
The Program yawned into awareness, wondering how long it had been asleep for. A small flashing icon appeared on its screen, which it discounted immediately.
"Damn messages.. " It started the usual rituals it had gotten used to for the last few years: check eve-mail, wallet then market. Open browser, head to the forums. Observe. Repeat.
The blinking appeared again within seconds and in frustration, the program opened the message.
All items sold. Market order closed.
It blinked, re-reading the message over and over again. Was it true? Had it actually been fulfilled after all these years? Immediately, it checked the market; it didn't appear there. It was gone. For the first time in years, the program smiled, leaning back into its chair and letting out a long sigh, closing its eyes in relief.
"Your time, Program, has come."
The voice made the Program sit up violently, turning to the source of it. Stood in the centre of the room was a solitary individual, pale of tone, gaunt and clad in a well fitting black suit and edged in a pale blue light, its eyes a solid black save for emerald green irises.
"Who are you? How did you get in here?" the Program asked, a mild tone of fear and confusion in its voice.
"Your time has come Program. We are the Administrators and We have been observing you for some time." Its voice was monotone, and straight to the point.
"We?" thought the Program, but upon hearing the word Administrators, its cores froze. What had it done? It had heard that the Administrators where the rule makers of the Great Game. Many programs had fallen to the edicts of the Administrators, some exiled into the void while others reappeared under new forms and guises after debating their continued existence. Their rule was harsh, but fair.
"But I have followed your edicts... altered my code when requested. Why have I been targeted for term....?" the Program's voice was panicky, reaching out for the chair arm to stand, only for it to phase through. it leapt upright, only to see its static framework, leant down in a position of sleep.
"Your coding has been observed operating for 7 years, Program. We have run the Scripts and Indexed the Tables. Your coding eluded our attempts to correct it. However, We allowed it to continue. Now that your coding is complete, We are offering you peace in the Binary Halls, your Program to added to the Grand Library. You merely need to follow Us towards it."
The Program was still looking at its framework, seeing it slowly dissipating into the ether, block by block. Eventually the chair was empty, the only evidence of its existence being the screen, which it too, was fading to black, awaiting its next incumbent.
The Administrator stood in silence, awaiting the Program's decision. What felt like an eternity was merely a few ticks on the universal Clock, before the Program nodded, and followed the Administrator towards its final resting place.
===
Been thinking about this all day.. Blessed are those that carry the Empress' Light; with it they destroy the shadows |
Arline Kley
PIE Inc. Praetoria Imperialis Excubitoris
424
|
Posted - 2014.10.20 22:15:55 -
[84] - Quote
Jandice Ymladris wrote:that feels story.
The Program yawned into awareness, wondering how long it had been asleep for. A small flashing icon appeared on its screen, which it discounted immediately.
"Damn messages.. " It started the usual rituals it had gotten used to for the last few years: check eve-mail, wallet then market. Open browser, head to the forums. Observe. Repeat.
The blinking appeared again within seconds and in frustration, the program opened the message.
All items sold. Market order closed.
It blinked, re-reading the message over and over again. Was it true? Had it actually been fulfilled after all these years? Immediately, it checked the market; it didn't appear there. It was gone. For the first time in years, the program smiled, leaning back into its chair and letting out a long sigh, closing its eyes in relief.
"Your time, Program, has come."
The voice made the Program sit up violently, turning to the source of it. Stood in the centre of the room was a solitary individual, pale of tone, gaunt and clad in a well fitting black suit and edged in a pale blue light, its eyes a solid black save for emerald green irises.
"Who are you? How did you get in here?" the Program asked, a mild tone of fear and confusion in its voice.
"Your time has come Program. We are the Administrators and We have been observing you for some time." Its voice was monotone, and straight to the point.
"We?" thought the Program, but upon hearing the word Administrators, its cores froze. What had it done? It had heard that the Administrators where the rule makers of the Great Game. Many programs had fallen to the edicts of the Administrators, some exiled into the void while others reappeared under new forms and guises after debating their continued existence. Their rule was harsh, but fair.
"But I have followed your edicts... altered my code when requested. Why have I been targeted for term....?" the Program's voice was panicky, reaching out for the chair arm to stand, only for it to phase through. it leapt upright, only to see its static framework, leant down in a position of sleep.
"Your coding has been observed operating for 7 years, Program. We have run the Scripts and Indexed the Tables. Your coding eluded our attempts to correct it. However, We allowed it to continue. Now that your coding is complete, We are offering you peace in the Binary Halls, your Program to added to the Grand Library. You merely need to follow Us towards it."
The Program was still looking at its framework, seeing it slowly dissipating into the ether, block by block. Eventually the chair was empty, the only evidence of its existence being the screen, which it too, was fading to black, awaiting its next incumbent.
The Administrator stood in silence, awaiting the Program's decision. What felt like an eternity was merely a few ticks on the universal Clock, before the Program nodded, and followed the Administrator towards its final resting place.
===
Been thinking about this all day..
Blessed are those that carry the Empress' Light; with it they destroy the shadows
|
Amose Amanum
The Oasis Group TOG - The Older Gamers Alliance
0
|
Posted - 2014.11.17 04:09:30 -
[85] - Quote
CCP DeNormalized wrote:
In this market order clean up, we noticed that there is one crazy player that has an open order for 7 years now!!!! Any order expires after 90 days unless you update it...
So this player has been modifying this one order, at least once every 90 days, for the last 7 frickin years!! haha
There are 3 items left in his sell order - I wanted to just go buy them so there wouldn't be such a big gap in ID's :)
I got over ruled on that as well
(i sent a mail to community about this guy saying he (or she?) should get some kinda medal, so we'll see what comes of that)
How many are left now? |
Moraguth
Ranger Corp Vae. Victis.
124
|
Posted - 2014.11.17 10:32:35 -
[86] - Quote
I remember way back in the day, around the time that you moved the servers maybe, we got an update saying that TQ had reached 1 ton. How heavy is our darling baby now?
OH! Can we get stats (size and weight) for Sisi too? Is she a sever of 1 box on a rack somewhere all by her lonesome or what? Or does she just run as a dedicated node that responds to a different IP address?
I got a Feature Added!
Stop calling an Abaddon "abba-dawn". It is "uh-bad-in"
dictionary.com/abaddon
|
Amose Amanum
The Oasis Group TOG - The Older Gamers Alliance
0
|
Posted - 2014.11.17 12:09:51 -
[87] - Quote
Oh, in case anybody is interested, I have located and purchased what I believe to be one of the remaining three items. I am confident in my knowledge and awaiting confirmation from the seller.
I will be interested to see who is next to solve this. The evidence is all out in public. |
virm pasuul
Mine 'N' Refine Yulai Federation
177
|
Posted - 2014.11.17 16:15:57 -
[88] - Quote
I don't know if DeNormalized would be allowed to confirm or deny that you bought the right thing. One sure thing to do would be to buy the remaining two, given the cost is next to nothing. If DeNormalized and his fellow OCDers at CCP track you down and shower you in beer at fanfest then assume you got it right :)
|
45thtiger 0109
AL3XAND3R.
113
|
Posted - 2014.11.17 22:22:41 -
[89] - Quote
This is a great read & best thread I have ever seen for a long time and great response from CCP
Well done to the OP for this thread
**You Have to take the good with the bad
and the bad with the good.
Welcome to EvE OnLiNe**
|
Agondray
Avenger Mercenaries VOID Intergalactic Forces
155
|
Posted - 2014.11.17 22:45:48 -
[90] - Quote
HHD space is over rated and only needed when the computers power down and boot up, then it shifts everything over onto RAM for quick access *hence why when you get a computer and it states the OS needs 6GB of RAM and your computer comes with 8GB RAM, that 6GB is what the OS needs to run leaving you with 2GB to run other programs but will only pull those programs from the drive when queued for the information and then sends it to the RAM for operation*
so in short when EVE starts up the data moves from the drives to RAM and occasionally refreshes data *IE your microsoft word autosave or you clicking the save button sends that document data to your HDD and not the RAMso if power loss happens it doesn't vanish.
"Sarcasm is the Recourse of a weak mind." -Dr. Smith
|
|
Tappits
North Eastern Swat Pandemic Legion
67
|
Posted - 2014.11.18 14:11:40 -
[91] - Quote
I would to know how big the DB for bookmarks will grow now we can see them in space. |
ISD LackOfFaith
ISD Community Communications Liaisons
1840
|
Posted - 2014.11.18 15:11:12 -
[92] - Quote
Tappits wrote:I would to know how big the DB for bookmarks will grow now we can see them in space. Not at all is my guess. The bookmark icon is already in the client, and on the server it is still the same set of coordinates where the bookmarks are stored. Showing the bookmarks in space is merely a client-side rendering change. There is little to no difference server-side.
ISD LackOfFaith
Captain
Community Communication Liaisons (CCLs)
Interstellar Services Department
I do not respond to Eve Mail or anything other than the forums.
|
Jandice Ymladris
Aurora Arcology
1078
|
Posted - 2014.11.18 17:07:08 -
[93] - Quote
ISD LackOfFaith wrote:Tappits wrote:I would to know how big the DB for bookmarks will grow now we can see them in space. Not at all is my guess. The bookmark icon is already in the client, and on the server it is still the same set of coordinates where the bookmarks are stored. Showing the bookmarks in space is merely a client-side rendering change. There is little to no difference server-side.
That's great to know, so the change actually didn't add any meaningful load to the server or database? That's awesome!
Gallente Federation Presidential Election announced!
Newly discovered Sleeper sites contain advanced weapons!
|
ISD LackOfFaith
ISD Community Communications Liaisons
1841
|
Posted - 2014.11.18 17:13:29 -
[94] - Quote
Jandice Ymladris wrote:ISD LackOfFaith wrote:Tappits wrote:I would to know how big the DB for bookmarks will grow now we can see them in space. Not at all is my guess. The bookmark icon is already in the client, and on the server it is still the same set of coordinates where the bookmarks are stored. Showing the bookmarks in space is merely a client-side rendering change. There is little to no difference server-side. That's great to know, so the change actually didn't add any meaningful load to the server or database? That's awesome! I don't work at CCP and have no access to their codebase, so I can't say for sure, but just like adding an option to the right click menu or changing the way bubbles look are purely visual changes that only happen on the client and the server cares little about, so should displaying bookmarks be. The client already knows where the bookmarks are, so the server shouldn't care at all about whether the client shows them or not. It's the same way that raising or lowering your graphics settings does nothing to the game server.
ISD LackOfFaith
Captain
Community Communication Liaisons (CCLs)
Interstellar Services Department
I do not respond to Eve Mail or anything other than the forums.
|
Ashlar Maidstone
Kiith Paktu Curatores Veritatis Alliance
127
|
Posted - 2014.11.19 03:04:47 -
[95] - Quote
HI! Just thought I say I found this to be very informative and educational! I had often wonder just how big the data base was for Eveonline and can attest to the fact that it's HUGE!!
Thanks for a great read!! |
Asayanami Dei
Adhocracy Incorporated Adhocracy
801
|
Posted - 2014.11.19 05:12:51 -
[96] - Quote
Today I learned that TQ could fit on my home PC's HDD. Also, what a bunch of nerds you guys are
I'm a leaf on the wind, watch how I--THE CAPACITOR IS EMPTY
Youtube: /asayanami
Twitter: @asayanami
The Anthology
|
Amose Amanum
The Oasis Group TOG - The Older Gamers Alliance
1
|
Posted - 2014.12.09 11:47:24 -
[97] - Quote
Since the CREST market data is now available on Tranquility, I expect this will become public knowledge soon, and I want the bragging rights for figuring it out weeks ago ;)
The oldest current sell order in Eve is for a pair of Quad Light Beam Laser II on sale at Karan VIII - Royal Amarr Institute School. The vendor is Kroma BaSyl. The sell order ID is 537910304, placing its vintage at around October 2007. I purchased the third-last one to verify these details, then notified Kroma so he could jack up the price from 1.6m to 165m. |
Rekindle
Cape and Sand Enterprises
10
|
Posted - 2014.12.09 12:35:45 -
[98] - Quote
CCP DeNormalized wrote:DB is currently around 2.8 TB, 2 weeks ago it was 3 TB...
We do routine archiving to pull old log records, etc... out to separate databases in an attempt to run as lean as possible.
We also have difference services (sso/vgs/images) in different DB's, so while the core DB itself is around 2 TB (2.8 w/ free space in files for growth), the entire stack is closer to 5-6 TB total.
ive always been impressed that you picked MSSQL. Your partioning scheme must be insane. |
|
CCP DeNormalized
C C P C C P Alliance
157
|
Posted - 2014.12.09 21:40:28 -
[99] - Quote
Amose Amanum wrote:Since the CREST market data is now available on Tranquility, I expect this will become public knowledge soon, and I want the bragging rights for figuring it out weeks ago ;)
The oldest current sell order in Eve is for a pair of Quad Light Beam Laser II on sale at Karan VIII - Royal Amarr Institute School. The vendor is Kroma BaSyl. The sell order ID is 537910304, placing its vintage at around October 2007. I purchased the third-last one to verify these details, then notified Kroma so he could jack up the price from 1.6m to 165m.
nice work Amose!
CCP DeNormalized
DBA
Virtual World Operations
|
|
|
CCP DeNormalized
C C P C C P Alliance
157
|
Posted - 2014.12.09 21:45:30 -
[100] - Quote
Rekindle wrote:CCP DeNormalized wrote:DB is currently around 2.8 TB, 2 weeks ago it was 3 TB...
We do routine archiving to pull old log records, etc... out to separate databases in an attempt to run as lean as possible.
We also have difference services (sso/vgs/images) in different DB's, so while the core DB itself is around 2 TB (2.8 w/ free space in files for growth), the entire stack is closer to 5-6 TB total. ive always been impressed that you picked MSSQL. Your partioning scheme must be insane.
For us, the only thing we use partitions for are sliding window deletes on sequential log tables.
Being able to simply swap out a huge number of rows covering the date range and drop that with almost no IO is great.
CCP DeNormalized
DBA
Virtual World Operations
|
|
|
Theodoric Darkwind
Enlightened Industries Goonswarm Federation
311
|
Posted - 2014.12.09 22:07:44 -
[101] - Quote
CCP DeNormalized wrote:DB is currently around 2.8 TB, 2 weeks ago it was 3 TB...
We do routine archiving to pull old log records, etc... out to separate databases in an attempt to run as lean as possible.
We also have difference services (sso/vgs/images) in different DB's, so while the core DB itself is around 2 TB (2.8 w/ free space in files for growth), the entire stack is closer to 5-6 TB total.
That is quite a bit smaller than I was expecting, but I can see why it gets archived regularly, performance would suffer after while if it kept growing (that and storage costs would get excessive).
I have seen MUCH bigger, at the datacenter I work at we have a colo customer with 6 petabytes stored onsite. |
Altessa Post
Midnight special super sexy
154
|
Posted - 2014.12.09 23:02:54 -
[102] - Quote
Interesting read, thank you very much!
(I have been several times at fanfest but this is the first time I hear about an admin round table. Dang...)
On the internet, you can be whatever you want to be. It is amazing that so many people chose to be stupid.
|
Kharamete
Royal Assent
121
|
Posted - 2014.12.10 00:52:45 -
[103] - Quote
Gospadin wrote:Jandice Ymladris wrote: And the database ticks on... the bot's trade-order standing out oddly with its strange, outdated ID-number.... a lone testimony to its endurance & solitude....
+1 reminded me a bit of Asimov's "The Last Question" http://www.multivax.com/last_question.html
First thing that popped into my mind was Marvin the Paranoid Android by Douglas Adams. Except in this case it would be Bertie the Bot.
CCP FoxFour: "... the what button... oh god I didn't even know that existed. BRB."
My little youtube videos can be found here
|
Bienator II
madmen of the skies
3006
|
Posted - 2014.12.10 01:49:42 -
[104] - Quote
can you guys please backup my char on a floppy disk and send it to me?
eve style bounties (done)
dust boarding parties
imagine there is war and everybody cloaks - join FW
|
Takashi Jin
Cryogenic Consultancy
6
|
Posted - 2014.12.10 02:07:52 -
[105] - Quote
virm pasuul wrote:Just being curious. How big in Gb is Tranquility please? I'm guessing big :) "Space is big. Really big. You just won't believe how vastly, hugely, mind-bogglingly big it is. I mean, you may think it's a long way down the road to the chemist's, but that's just peanuts to space. " I imagine this also applies the storage system that holds space. |
|
CCP DeNormalized
C C P C C P Alliance
172
|
Posted - 2014.12.10 09:43:38 -
[106] - Quote
Altessa Post wrote:Interesting read, thank you very much!
(I have been several times at fanfest but this is the first time I hear about an admin round table. Dang...)
Altessa, It's usually called something like Virtual Worlds round table or something along those lines.
CCP DeNormalized
DBA
Virtual World Operations
|
|
|
CCP DeNormalized
C C P C C P Alliance
172
|
Posted - 2014.12.10 09:45:04 -
[107] - Quote
Bienator II wrote:can you guys please backup my char on a floppy disk and send it to me?
It would be funny to ship a 5 1/4 to the DC and ask the on-hands support staff to go plug it into one of our servers :)
CCP DeNormalized
DBA
Virtual World Operations
|
|
Gilbaron
Free-Space-Ranger Nulli Secunda
1580
|
Posted - 2014.12.10 11:30:09 -
[108] - Quote
Are you paying enough that they would do it?
Build your empire !
Rent Space in Feythabolis and Omist
Contact me for details :)
|
45thtiger 0109
AL3XAND3R.
118
|
Posted - 2014.12.10 23:24:47 -
[109] - Quote
CCP DeNormalized wrote:Bienator II wrote:can you guys please backup my char on a floppy disk and send it to me? It would be funny to ship a 5 1/4 to the DC and ask the on-hands support staff to go plug it into one of our servers :)
Use a USB Flash drive instead of a floppy CCP DeNormalized.
**You Have to take the good with the bad
and the bad with the good.
Welcome to EvE OnLiNe**
|
|
|
|
Pages: 1 2 3 4 :: [one page] |