Quote:

---

function makeMultiUpsert(array $data, array $params, $table, $dsn) {
// Need this so we can do quoting.
$con = connect($dsn);
$needsQuote = array('C', 'X', 'D', 'T');
// Build query sections
$insert = 'insert into ' . $table . ' (`';
$insert.= implode('`,`', array_keys($params)) . '`)';

... a little further down ...

// Loop thru and build update section.
$updates = array();
foreach($params as $k => $v) {
$updates[] = "`" . $k . "`" . '=values(' . "`" . $k . "`" . ')';
};

---

Quote:

---

[2008-12-18 13:40:45.651] Tired of waiting! Getting eve-api-pull for 0
[2008-12-18 13:40:45.658] Tired of waiting! Getting CharacterSheet for 91xxxxx

---

Quote:

---

[2008-12-19 05:43:34.747] DATABASE: Before connect for mysqlt://webX:[email protected]/eve_dbo?new in common_db.in
[2008-12-19 05:43:34.754] DATABASE: Before connect for mysqlt://webX:[email protected]/eve_dbo?new in common_db.in
[2008-12-19 05:43:34.755] Tired of waiting! Getting eve-api-pull for 0
[2008-12-19 05:43:34.756] DATABASE: Before connect for mysqlt://webX:[email protected]/eve_dbo?new in common_db.in
[2008-12-19 05:43:34.756] DATABASE: Before connect for mysqlt://webX:[email protected]/eve_dbo?new in common_db.in
[2008-12-19 05:43:34.757] CHAR: Connect before section in eve-api-pull.php
[2008-12-19 05:43:34.757] DATABASE: Before connect for mysqlt://webX:[email protected]/eve_dbo?new in common_db.in
[2008-12-19 05:43:34.757] CHAR: Before GetAll $charList in eve-api-pull.php
[2008-12-19 05:43:34.758] CHAR: Before require pulls_char.inc
[2008-12-19 05:43:34.761] DATABASE: Before connect for mysqlt://webX:[email protected]/eve_dbo?new in common_db.in
[2008-12-19 05:43:34.762] Tired of waiting! Getting CharacterSheet for 9XXXXXXX

---

Originally by: Eldstrom

---

Schedule task would be the windows equivalent to a cronjob.

Eld

---

Originally by: Juloshko

---

Originally by: Eldstrom

---

Schedule task would be the windows equivalent to a cronjob.

Eld

---

but what am i scheduling? is it one of the php files
(never done anything like cronjob before)

---

Originally by: Juloshko

---

but what am i scheduling? is it one of the php files
(never done anything like cronjob before)

---

1. Create a database in MySQL for your tables. Call it something like yapeal


2. You'll want to run the Yapeal.sql file in that database to create all of the tables


3. Copy the sample config in config/ to config/yapeal.ini and update it with the values appropriate for your system (database location, username, password)


4. Create a row in yapeal.RegisteredUser containing your userid/api key info


5. Create rows in yapeal.RegisteredCharacter and yapeal.RegisteredCorporation appropriate for your char/corp info and set isActive to 1 in those rows


6. Run backend/eve-api-pull.php and it should populate all of those tables with the info associated with your user/corp as set above. Set it to run periodically to automatically keep your data up to date.


7. Now write your favorite web applications to interact with those tables

• Added a new class for tracing and changed code to use it. The tracing code was starting to get overwhelming and had some limitations that I'm trying to overcome.


• Added new required setting in yapeal.ini needed by new tracing code. There is now another variable named trace_output that needs to be set to "file", "database", or "both". Sending the tracing information to the database isn't active yet but is being looked at for the future.


• Removed the old unused setting in yapeal.ini for use_exception since all the code had already been updated to no longer use it. It was left over from time when code used both errors and exception in areas. Code now only uses exceptions so this setting is no longer needed.


• Changed location and how the CachedUntil table is updated. In some error conditions when the database wasn't update the cachedUntil time still would be, now the cachedUntil time is set slightly in to the future and only set to cachedUntil time from XML if we actual update the related table(s). This should also let Yapeal recover quicker from temporary error conditions by API server.


• Moved the function getAPIinfo() used to get data from API into it's own file inc/common_api.inc instead of having it in the inc/common_db.inc file.


• Fixed some typos in trace and error messages and probably made some new ones Also did varies other small changes here and there to code formatting etc.

Originally by: Dragonaire

---

• Moved the function getAPIinfo() used to get data from API into it's own file inc/common_api.inc instead of having it in the inc/common_db.inc file.

revision 355 is up with the new changes enjoy.

---

• Then go to Eve Insider > My Character and sign in as needed


• Click on the character you want information for


• Click link to get XML data and from there you can get your characterID and corporationID


• Go back to character info page and scroll down to the API section and click the link there


• Read the info on the page about API keys then click button to get full API Key and either copy & paste it to a text file to save it or just write down your userID and API Key


• Now you'll need to add the information you've collect to the RegisteredUser and RegisteredCharacter tables like Ryel Theon wrote up in post 46 of this thread or you can find wrote up in the Yapeal wiki pages

Originally by: Dragonaire

---

Mintoko - I've been looking at adding some kind of prefix to all the table names because some of the API re-use the same names in the rowsets but with different columns (fields) An example would be 'skills' in both the CharacterSheet and SkillTree. To add any kind of prefix though will require editing most the SQL queries in Yapeal since most places the table names are hard coded into the SQL Probably a bit of lack of foresight on my part but something that often gets overlooked when try to get something working.

I'm working on some changes to Yapeal that should make adding more APIs in the future easier and as part of that I plan on adding some kind of prefixing system so it's less of a problem. I'm not sure when I'll release these changes since it's very much in an early stage of development and I haven't even got any running code yet so best I can say now is it's on the list of things I plan to do

If you decide you can't wait and go ahead on your own and make something hopefully you'll share it back with us and maybe I'll be able to add it into Yapeal for everyone else that might have the same need.

---

• Some kind of install/setup script


• Some thing to help with managing the RegisteredUser/RegisteredCharacter/RegisteredCorporation stuff


• Better documentation

• Moved the Docs directory out of the project directories in trunk and all the branches and put them into their own top level directory. I never seem to have any time to update them so no need confusing people with having outdated information being included. Also makes Yapeal a little faster to download and easier to integrate for people that don't want or need to include them with their projects.


• Added new admin top level directory. I'm looking at maybe having a download/installer setup for people that don't or can't use subversion and I need to have a place outside trunk or the branches to keep the config files for it plus a few other misc stuff that isn't needed to use Yapeal but I need while working on it. So you might notice a few more things migrating over there as I run across them.


• Finally I found some nice little graphics again that someone made for me to use with Yapeal a while back and I decided might be nice for me to include them for people to use in their own projects etc. If you want to include one of them on your website with link back to Yapeal's website that would be great but only do it if you feel like it. I'm happy if you just let me know with post on forum or an E-mail that you like it and are using it.

Quote:

---

Once you updating an assetlist, will this script delete those info that have been used or sold or related to that ??

---

Originally by: Dragonaire

---

Hi Satis Iqulenax glad you like Yapeal.

Quote:

---

Once you updating an assetlist, will this script delete those info that have been used or sold or related to that ??

---

No it doesn't try to make any changes to the AssetList or any of the other API data really for that matter. I don't see that being part of the job it's trying to do. Yapeal tries to just take what it gets from the Eve API and put it into the DB in what I hope is a sensible way. To do that and be usable by multiple characters and corporations it does add a few extra columns like ownerID, accountKey, etc to the tables but I never take stuff away I leave that up to you as the application developers to decide what you want to do.

---

Quote:

---

Also for anyone else looking at Yapeal as a way to have a full archive of all of the Eve API data keep in mind that things like ServerStatus, AssetList, etc are thrown away and replaced in effect. I did this because I felt having it act a snapshot of the in game data was what most people would be interested in and what the APIs were made to allow.

---

Originally by: Ragga daPhunk

---

the only thing that gets updated in the database is the "CachedUntil" table but nothing else.

---

Originally by: Dragonaire

---

You need to read the full post. But the way I worded it could be misunderstood so I'll try to rephrase it to be more clear. For all the APIs under eve, and server, they will have all their records truncated and then replaced by the new data pulled from the API. In tables like AssetList all records on a per ownerID basis well be deleted and replaced with the new data from API. For tables like WalletJournal, WalletTransactions, etc because of their nature they will just be added to. In MarketOrders and IndustryJobs they will be update by the new data until it stops changing then they do the same as WalletJournal, etc and keep a record of the last update received. This let's you look up old records if you want something that you can't do in game.
Here an example for a market order. You make a sell order for some ammo as people buy it from you the record is update with the amount left to sell in volRemaining. Now the API may return a record where orderState=2 meaning it has either expired or someone bought it all up before it ran out. You'll have to check if volRemaining=0 to tell if it was bought out. We will continue to receive it in more updates from the API for a while because of how the API cache works but since our order doesn't change anymore it's basically ignored at this point. just like updates to unchanging records for WalletJournal would be. The record for your order will stay around until you decide to delete it.

Hopeful this makes it more clear to you how Yapeal does things.

---

Originally by: Dragonaire

---

Glad to hear I was clearer on my second try.

At some point I would like to see Yapeal do all the APIs and I plan on making some changes to how the code works so it's easier then it is now to add more APIs. I'm hoping to get it easy enough that I'm not the only one that can seems to understand it well enough to add more

---

Originally by: Dragonaire

---

And a big thanks out to Satis Iqulenax for catching this

---

Originally by: Buzz AU

---

Hi Dragonaire,

I have tried downloading this, but have been unsuccessful. I cant find a way of extracting the .bin file, and using Tourtise to connect to SVN asks me to authenticate.

How dows someone use this?

---

1. Create a folder where Yapeal should be placed.


2. Right click on the folder and chose: SVN Checkout


3. In the Url you input: http://yapeal.googlecode.com/svn/trunk


4. Now press the OK button and it should get the latest version of Yapeal.


5. Now each time you wan't to update to the latest version just right click the folder and chose: SVN Update and it will automatic update to the latest one.

Originally by: Satis Iqulenax

---

Dragonaire I have an question to the AssetList table.

I notised that there it a rowname caled: "lft" and "rgt"

When I looked in the XML AssetList they was not mentioned in there.
Has that somthing to do with the Child of a container or the fitting on a ship ??

If so... can you give a little explanation on how those numbers are working together.

Kind Regards
Satis

---

Originally by: Satis Iqulenax

---

Dragonaire did you read this ??

Originally by: Satis Iqulenax

---

Dragonaire I have an question to the AssetList table.

I notised that there it a rowname caled: "lft" and "rgt"

When I looked in the XML AssetList they was not mentioned in there.
Has that somthing to do with the Child of a container or the fitting on a ship ??

If so... can you give a little explanation on how those numbers are working together.

Kind Regards
Satis

---

Waiting for an answer


Kind Regards
Satis

---

Originally by: Dragonaire

---

Edited by: Dragonaire on 14/01/2009 18:11:23
Sorry I did miss you asking that. Here a pages with some links I found interesting when deciding how to implement it. Johnathan Roark there actually developed the test code I adapted to Yapeal to replaced what I had been using before which was extremely slow. The library I was using before took up to 20 minutes to add 2000 records where now it's done in a few seconds

Also might want to look back around post 30 on this thread where someone else was asking about them and I made a few comments to help get them started.

---

Originally by: Johnathan Roark

---

Its to persevere the tree format using the "nested set" module. MYSQL Tree Treversal

---

Originally by: Buzz AU

---

Edited by: Buzz AU on 15/01/2009 12:48:40
Looks like I closed chrome before I posted my last message:

Thanks for the instructions on Tortoise, it worked well!!

Are there new instructions on how to get this up and running?

The ones on the main google code site, dont really answer much.

Where do I enter the details for my database? Where do I enter my API information? I checked the yapeal.ini but dont see anything related to the above the the SQL db, and also cant find where I activate which API info I want to pull.

If there is a post on this, please can you point me to it.

Thanks

---

Quote:

---

some sort of verification for api keys.

---

Quote:

---

when there is an authentication problem the script stops.

---

Originally by: Dragonaire

---

First I'd like to thank Satis Iqulenax for offering to help with some of the document fixes and additions she's working on. I'd also like to thank her for taking on making some kind of installer to make it easier for people to try out Yapeal.

---

Originally by: Dragonaire

---

Edited by: Dragonaire on 15/01/2009 20:48:03
Best way would be through my E-mail either from the project files or the one at Google. I'm also usually on Gchat. I use an alt's name for them just look at the Yapeal project owner to figure it out.
Using eve-mail is a slow way to get hold of me. I'm usually only on to skip skills for my characters once in a while instead of playing Eve I spend most of my free time working on Yapeal

---

• the grafical UI is done


• The requirement test is done


• The basic cofiguration input site is done. There will be more advanced setups like chosing different databases to each setup groups


• Working on database creation right now.

1. Download Tortoisesvn


2. Install Tortoisesvn


3. Create a folder where Yapeal should be placed.


4. Right click on the folder and chose: SVN Checkout


5. In the Url you input: http://yapeal.googlecode.com/svn/trunk


6. Now press the OK button and it should get the latest version of Yapeal.


7. Now each time you want to update to the latest version just right click the folder and chose: SVN Update and it will automatic update to the latest one.

Quote:

---

Welcome to Yapeal Installer.
This installer will setup Yapeal EVE API Library to be runned on your site.
The setup will check if your web host has the requirements to support this library.

---

Quote:

---

The setup is done.
You can now run the backend/eve-api-pull.php to cache all the data

---

Quote:

---

Forbidden

You don't have permission to access /Yapeal/backend/eve-api-pull.php on this server.

Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request.

Apache/2.2.10 (Unix) mod_ssl/2.2.10 OpenSSL/0.9.8i DAV/2 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635 Server at www.mysite.com Port 80

---

Originally by: Buzz AU

---

Is that to say, we shouldn't run it using a normal cron job?

---

Originally by: Buzz AU

---

Is that to say, we shouldn't run it using a normal cron job?

---

• CLI or Command Line Interface is a generic term that the designers of PHP use to describe any console type interface i.e. NOT windowed or web. On most Unix systems this is normal sh, on Linux it's Bash or one of several others if the user changes it. With Windows systems you have cmd.exe which you can usually access through the classic start menu by Start > Run and typing in cmd and clicking OK.
  If you use anything like SSH to get to your hosted web server you are also run a CLI, usually Bash, with the input and output in effect redirected to your local machine over an encrypted connection.
  


• Cron or also know as crontabs is a system available on most Unix/Linux to run CLI programs/scripts for a user at different starting times and intervals. Generally only the interval part is used where it can be anywhere from 1 minute to hours, days or clear out to years in the future.


• Schtasks provides the same basic functionality as crontab does for Unix/Linux systems.


• Yapeal short for Yet Another Php Eve Api Library is a CLI PHP5 script that gets information from the Eve XML API and puts it into a MySQL database. A web based installer has also been made for it to help people get started with it but the main script is only made to be run from a CLI or as a crontab job.

1. Setup a webserver on windows using Wampserver


2. Install Yapeal on your windows webserver


3. Guide to setup task scheduler for Yapeal in windows (Like cronjob)

Originally by: Buzz AU

---

In that case, change the final step in the installer, to not say "now you can go to /backend/.."

---

Originally by: Nogap toosmall

---

and your understanding of probability is on par with a radish.

---

Originally by: Cryten Jones

---

Could anyone tell me what the lft and rgt column in the assets table are? I can't see them anywhere on the api documentation!

Also, how does yapeal deal with the Item X is inside Item Y? The xml provides a 'contents' value but as far as I can see yapeal just sets assets locationID to the same as their containers..is this right?

Thanks

-CJ

---

Originally by: Dragonaire

---

Something that might give everybody a better understand of some of the power that nested sets gives you here's some examples.

---

• Table name prefixes. Many people are only allowed a single database at their hosting site so they need to have their applications and Yapeal tables all play nice together. I was also running into some issues with APIs using duplicate names on some rowsets which adding table name prefixes would also help solve.


• Ability to use multiple database to store all of Yapeal's varies tables has been dropped. This allowed for many of the other changes to be done much easier and was believed to be a largely unused feature. With the addition of user settable table prefix name the need for this is believed to be largely mote now so it was removed.


• There will be some changes to the database tables. All the table names have been changed to add a two part prefix the first part is user configurable and second part set internally by Yapeal.


• Some new tables have been add for additional APIs or old APIs that have been expanded on to make them more complete.


• Each API is now implemented as it's own class which solves many of the problems of changes to one API effecting others. This has also made adding more APIs easier and should make it easy for other programmers to understand how to add an API. That should mean not always having to wait on me to get around to adding new ones. This doesn't mean I won't be continuing to add APIs just that maybe I won't have to do all of them myself. At least that is my hope anyway.


• Some bugs and mis-features fixed. Probably added a few new ones but I've been do much more testing on this code then some of the code I've released in the past.


• The yapeal.ini has had a major overhaul and been streamlined. Dropping multiple database table support was one of the main things helping with this but there were many other factors that made this possible.

• [char|corp]StandingsToCharacters


• [char|corp]StandingsToCorporations


• [char|corp]StandingsToAlliances


• [char|corp]StandingsFromAgent


• [char|corp]StandingsFromNPCCorporations


• [char|corp]StandingsFromFactions

Quote:

---

(one of them an enum field for the rowset name)

---

Originally by: Dragonaire

---

Ok after looking at the both APIs some more the way I'd do the character one is to have the 5 tables named charStandingsToCharacters, charStandingsToCorporations, ..., [..]

Doing it this way does result in a large number of small tables with long table names but will make getting data back out in applications easier I believe.

---

Quote:

---

You've managed I believe to have picked one of the harder APIs to tackle first :)

---

• Fixed bug with charWalletTransactions. This may require you to alter a table, details below.


• Added standings API for characters and corporations. Thanks to Ramov Tinoga for making it and writing such nice clean code made it easy to test and add with only minor additions.


• APIs to pull can be selected on a per char/corp basis ie if you only want to get CharacterSheet and AccountBalance for a character or only AssetList and MarketOrders for a corp now you can.


• Updated configurer thanks to Satis Iqulenax. It now includes an update section for those of you upgrading a recent version.


• Configurer now let's you select which APIs you wish to get. Needed to work with change above.


• The usual minor tweaks and improvements etc that I never seem to run out of

Quote:

---

ALTER TABLE `charWalletTransactions` DROP COLUMN `characterID`;
ALTER TABLE `charWalletTransactions` DROP COLUMN `characterName`;

---

Quote:

---

I have one suggestion regarding the corp tables. Currently the ownerID fields within the corp tables is only the corporationID, but does not include any character related information. Would it be possible to add another "ownerID" field with character identifiers?

---

Quote:

---

Maybe call it ownerIDchar, and have it contain a space delimited list of the characterID for each character (registered in utilRegisteredCorporation) that can get that info from the API.

---

Quote:

---

SELECT `characterID`,`name` from corpMemberTracking WHERE (`roles` & 1) = 1;

---

Originally by: Dragonaire

---

Some of the APIs also let you have access by just being a member of the corp or by having some role in the corp like accountant, etc. There are a couple ways to look up if a character has the needed roles in a corporation.

---

Originally by: Dragonaire

---

NEW HOME http://code.google.com/p/yapeal/

---

Originally by: Tenshi Ryu

---

Edited by: Tenshi Ryu on 15/03/2009 07:12:53

Originally by: Dragonaire

---

NEW HOME http://code.google.com/p/yapeal/

---

Can someone please tell me where the heck on the above website I can download this? I been over it from top to bottom .... NOTHING!!!!

pleeeeeeasse help ... I really wanna try this.

---

Quote:

---

Available through subversion at new home.

---

Originally by: Selene D'Celeste

---

Following the steps here: http://code.google.com/p/yapeal/wiki/InsYapWinSer

I get to "setup.php?install=step3" of the Yapeal setup and the apache server crashes.

Problem signature:
Problem Event Name:APPCRASH
Application Name:httpd.exe
Application Version:2.2.11.0
Application Timestamp:493f5d44
Fault Module Name:php5ts.dll
Fault Module Version:5.2.9.9

I can't find any more information on what could be configured wrong to cause this. Ideas?

---

• Fixed errors caused by merging a project member's killboard version of the *KillLog xml definitions from one of his other projects instead of one without the extra columns


• Fixed minor missed edit to corpAssetList that caused warning messages when running yapeal.php

Quote:

---

nullPHP Warning: mime_magic: type regexBEGIN[[:space:]]*[{]application/x-awk invalid in Unknown on line 0 PHP Warning: mime_magic: type search/400\\inputtext/x-tex invalid in Unknown on line 0 PHP Warning: mime_magic: type search/400\\sectiontext/x-tex invalid in Unknown on line 0 PHP Warning: mime_magic: type search/400\\setlengthtext/x-tex invalid in Unknown on line 0 PHP Warning: mime_magic: type search/400\\documentstyletext/x-tex invalid in Unknown on line 0 PHP Warning: mime_magic: type search/400\\chaptertext/x-tex invalid in Unknown on line 0 PHP Warning: mime_magic: type search/400\\documentclasstext/x-tex invalid in Unknown on line 0 X-Powered-By: PHP/4.4.8_pre20070816-pl1-gentoo Content-type: text/html <br /> <b>Parse error</b>: syntax error, unexpected '{' in <b>/home/nthr/www/yap/yapeal.php</b> on line <b>101</b><br />

---

Quote:

---

X-Powered-By: PHP/4.4.8_pre20070816-pl1-gentoo

---

Originally by: Meissa Anunthiel

---

Hi Dragonaire,

Your early comments refer to a yapeal.sql file that doesn't exist [anymore?].

Followed your InsYapWinserver documentation to install, everything is fine, works flawlessly until you reach the "Character Select and API Pull Select".

There's no such thing. :-)

---

Originally by: Bonechewer

---

Hey guys...

Ive got a bit of a problem with the SVN ive downloaded. The password field is not provided during the setup. So when i get to http://192.168.1.56/yapeal/install/setup.php?funk=configini ... no matter what i try, it doesnt work.

Any ideas ?

---

Quote:

---

It is possible with yapeal when my user is register and put the api key, this key save it on database for future use from user?

---