"Roster Master" - Guild Roster for Your Personal Guild Website

[Dark_Grue]

Not just sorted out, sorted out in spades. Big thank you to you-know-who.

Also thanks to Lantis, who really was the person responsible for making things happen for the Roster Master community. Expect bright new things to come out of both RM ports soon as we've got data, data, DATA!

Hopefully I'll have some time to program during the holidays, I'm still trying to get back into my regular routine after having a little trouble with a capitol "C" (I'm fine now).

We'll see how good my code comment discipline was when I start revising the code after letting it sit for over three months... I can't remember the last time I looked at the parser, and that's one of the first things that's going to need a heck of a cleaning! =P

[Lantis]

Dark_Grue wrote:

We'll see how good my code comment discipline was when I start revising the code after letting it sit for over three months... I can't remember the last time I looked at the parser, and that's one of the first things that's going to need a heck of a cleaning! =P

Kinda helps being able to scrap our Unholy Trio of parsers (XML-HTML-CSV) and replace it with a shiny new Twin Engine Parser (tm pending) to handle both guild and roster data   After a few hours I have a mostly working setup already - I'll try to bounce my code at you later tonight.

[Seagoat]

Dark_Grue wrote:

Hopefully I'll have some time to program during the holidays, I'm still trying to get back into my regular routine after having a little trouble with a capitol "C" (I'm fine now).

Holy crap, Grue...I'm glad you're ok!! You're not allowed to go anywhere, just so you know.

[Lantis]

Progress update:

RMSA is now fully interfaced with the new data feeds, and working pretty well.  Those feeds DEFINITELY update more often than the old ones

So far I have focused on rewriting the data parser, and handling the data fields I was already supporting in 4.5.0.  Once that part is fully finalized I will start working on adding new data fields.  There are quite a lot of them to chose from, I will have to decide which to support.

I can't give any solid ETA, but my guess is I should have something ready before Christmas (if no unforseen issue arises).

[Lantis]

Progressing faster than I was expecting.  Have a look at the current development version here.  Check out the new Combat and History links at the top (and of course, the displayed fields on both pages are 100% configurable).

[Nashbry]

Lantis@Antonia Bayle wrote:

Progressing faster than I was expecting.  Have a look at the current development version here.  Check out the new Combat and History links at the top (and of course, the displayed fields on both pages are 100% configurable).

Very nice indeed.  Thanks for working on such a program.  I know you are extrememly busy with this right now but if the mood strikes you (and seriously I won't be offended if you choose not to, you probably have many better things to do) my guild uses glfusion to run our site, if you ever get the chance, integration for that cms would be very helpful.  If not, that is cool too, the standalone will work just fine =o)

[Nerolathe]

Not to stray off here, but could you all tell me where to find these feeds? Apparently I'm just being stupid and can't think of a good enough set of keywords to find 'em.

[Lantis]

Nerolathe@Butcherblock wrote:

Not to stray off here, but could you all tell me where to find these feeds? Apparently I'm just being stupid and can't think of a good enough set of keywords to find 'em.

They only made them public last Friday.  It's on the Station Forums: http://forums.station.sony.com/stat...category_id=107

[Lantis]

Nashbry wrote:

Very nice indeed.  Thanks for working on such a program.  I know you are extrememly busy with this right now but if the mood strikes you (and seriously I won't be offended if you choose not to, you probably have many better things to do) my guild uses glfusion to run our site, if you ever get the chance, integration for that cms would be very helpful.  If not, that is cool too, the standalone will work just fine =o)

Since each CMS/Forum is completely different and authentication support usually requires a lot of time and effort (assuming it's actually doable - I've ran into some where it was virtually impossible), I prefer not to develop any additional auth module to RMSA (unless it were one widely used enough to justify the effort, and assuming also that integration is actually possible).  Sorry - I prefer to focus my efforts on the core itself.   Not saying that someone else couldn't write his own auth module.  The 6-7 supported modules already available can often serve as a starting base.

[Nerolathe]

Lantis@Antonia Bayle wrote:

Nerolathe@Butcherblock wrote:

Not to stray off here, but could you all tell me where to find these feeds? Apparently I'm just being stupid and can't think of a good enough set of keywords to find 'em.

They only made them public last Friday.  It's on the Station Forums: http://forums.station.sony.com/stat...category_id=107

Thank you so much, didn't even know we had those forums to be honest...

[Dethdlr]

Lantis@Antonia Bayle wrote:

Progressing faster than I was expecting.  Have a look at the current development version here.  Check out the new Combat and History links at the top (and of course, the displayed fields on both pages are 100% configurable).

Gotta say Lantis, that's looking pretty sweet.  Hopefully Dark Grue will be able to adopt a good bit for the RM4DF version (which I use on my guild site).  

[Lantis]

Dethdlr@Butcherblock wrote:

Gotta say Lantis, that's looking pretty sweet.  Hopefully Dark Grue will be able to adopt a good bit for the RM4DF version (which I use on my guild site).  

Thanks   Some of the work I initially did on LOTRoster to handle multiple pages of stats as well as the handling of unlisted characters is paying off as I needed these for this new version of RMSA as well.   I have over 30 user-configurable fields to chose from right now.  I decided to skip on many fields because they feel rather irrelevant (like the basic int/str/wis/dex stats).  I might still add a few more, but it's pretty close to a final list for now, unless people request adding a few more.  But otherwise, what you currently see on that dev install is nearly every available stats, spread over 5 pages of roster.

I wonder what's up with Grue tho - I haven't heard from him since last week   Hope everything is allright.

[Dark_Grue]

Lantis@Antonia Bayle wrote:

I wonder what's up with Grue tho - I haven't heard from him since last week   Hope everything is allright.

 Just busy and no time to code. I've been glancing at the email traffic, but haven't formed any opinions to merit commenting on anything.

I did code a Dragonfly admin panel (had to do a bit of research to remember the style guide for that...) to allow people to look up Guild IDs, but in truth I just haven't had much time to look or think about code.

I'm hoping I'll have some spare time over the holiday to start coding the new stuff that'll be required for the next version (RM4DF XXXML Edition!), at least get the new parser up and maybe establish a new DB schema.

Other than that I'm Still Alive.

[Lantis]

Dark_Grue wrote:

Lantis@Antonia Bayle wrote:

I wonder what's up with Grue tho - I haven't heard from him since last week   Hope everything is allright.

 Just busy and no time to code. I've been glancing at the email traffic, but haven't formed any opinions to merit commenting on anything.

I did code a Dragonfly admin panel (had to do a bit of research to remember the style guide for that...) to allow people to look up Guild IDs, but in truth I just haven't had much time to look or think about code.

I'm hoping I'll have some spare time over the holiday to start coding the new stuff that'll be required for the next version (RM4DF XXXML Edition!), at least get the new parser up and maybe establish a new DB schema.

Other than that I'm Still Alive.

I'm glad everything is fine - I was wondering since you had totally disappeared from the face of the Earth not long after that message you posted here about having to go through some major issues recently.

The good news is, so far I have encountered only one real (minor) technical issue working with this: the fact that so many characters return no data from the feeds as they haven't logged back since the feeds went live a few months ago.  I got a fairly elegant (IMHO) way to handle it, based on how I did it on my other roster project.

The biggest challenge with this turns out to be that there is so much to write, with all those new fields - it's a LOT of work.  I can see you having difficulties finding time to work on it - I've probably spent a good 30+ hours on this in the past 10 days (thankfully my evenings and weekends are fairly quiet these days).  Hopefully you'll be able to reuse some of that work yourself to save time, but I suspect it will depend on just how much of that data you want to expose to your users, and how to do it (I could thankfully take advantage of previous work I had done to handle multiple roster pages).

If you want to have an early look at my code just let me know, I'll send you what I've got so far.  This is getting pretty close to a first beta version, provided I can stop telling myself "Oh!  Let's add that other field as well!"

And once again, kudos to Seagoat for providing me with fresh pixels!  These make a long list of names and stats so much more fun to stare at

[Dark_Grue]

Lantis@Antonia Bayle wrote:

I'm glad everything is fine - I was wondering since you had totally disappeared from the face of the Earth not long after that message you posted here about having to go through some major issues recently.

Oh, yes, well the worst of things was already past even when I wrote that. But there's still paperwork to do and I'm just starting getting back up to speed at work. You see, I've been out on medical leave for 6 weeks. Kidney cancer, you see. I had my whole right kidney removed, cancer and all. It was all pretty sudden, actually.

I didn't want to make too big of an issue of it though. I'm doing just fine now. Cancer should be all gone now.

Lantis@Antonia Bayle wrote:

The good news is, so far I have encountered only one real (minor) technical issue working with this: the fact that so many characters return no data from the feeds as they haven't logged back since the feeds went live a few months ago. I got a fairly elegant (IMHO) way to handle it, based on how I did it on my other roster project.

Yeah, that's a frustrating aspect of the way the data server works. I'm still pondering that one, though I may take a look at how you solved it first. I did have some ideas about having some sort of user notification for claimed characters without data, to tell them to log the characters in, but I haven't started any implementation.

w Feel free to send anything along, though I'm afraid that it'll be a little one-sided for a while, I just haven't gotten all that far into the details yet.

Lantis@Antonia Bayle wrote:

The biggest challenge with this turns out to be that there is so much to write, with all those new fields - it's a LOT of work. I can see you having difficulties finding time to work on it - I've probably spent a good 30+ hours on this in the past 10 days (thankfully my evenings and weekends are fairly quiet these days). Hopefully you'll be able to reuse some of that work yourself to save time, but I suspect it will depend on just how much of that data you want to expose to your users, and how to do it (I could thankfully take advantage of previous work I had done to handle multiple roster pages).

Yeah, being able to leverage previous work will be good. I'ts always nice when forsight pays off.  So I'm pretty sure the existing module and template system that filtered into RM4DF versions back will allow for that customization for RM4DF, albiet for advanced users (at least at first). I still have a bunch of new data collections and modules I have ideas to code...

LOL, yeah, lots of ideas, not enough time to implement them and get them working the way one would like. It'll be an incremental process, I'm sure. I'll probably have to be content with mostly just getting the existing features working for the first release(s)... Getting the schema locked down is goingt obe very frustrating, since changing that and having an upgrade process for it is probably one of the biggest PITA tasks for a release. Writing the module installer is definitely one of the parts I don't enjoy.

[Lantis]

Fields that will be available in RMSA 5.0.0 (let me know if you can think of anything else worth it, I'll see if it's available):

avatar username typeBasic fields: name rank rankname (combined) race deity advclass tradeclass sectradeclass alternateadvancementsHistory: joined playedtime last_updated creationdate

PvP: pvpwildkills pvptitlerank pvpkillstreak pvpdeaths pvpdeathstreak pvpcitykillsCombat: critmit critchance critbonus noxiousres arcaneres elementalres physicalres critmit health power

Achievements: status quests achievements achievementpoints rare_harvests items_crafted collectionsCustom fields and others: custom1 custom2 custom3 custom4 custom5 dkp (when linking with a supported DKP application)

[Lantis]

RosterMaster StandAlone v5.0.0 Beta 1

Now available for download   This is a pretty major update in terms both of work and features.  Make sure you do read the changelog for update instructions.

Only one known issue so far: characters linking back to EQ2Players don't work because SOE has delayed the release of the redesigned EQ2Players website.  Once they put the new site live, I will be able to update RMSA to properly link your characters back to that new site.

Changes in 5.0.0 Beta 1 (21-Dec-2011)

This is the biggest update in years, thanks to the availability of new character data feeds from SOE.

*** The database schema has changed - make sure you select the appropriate database upgrade from the configuration page.

*** Many changes in available fields - make sure you edit your configuration.  Using the available presets as a starting point is strongly recommended.

*** PHP requirement has been bumped to 5.0, with SimpleXML support required.

*** German (and French, in part) translations are outdated.  If you can help update these, please contact me.

• NEW: Data retrieved from new XML data feeds provided by SOE.  These provide much more data for me to play with than the previous basic XML/CSV feeds, and they should also be far more reliably updated. Note that characters that haven't logged since those feeds went live will be reported as "No Data" on the roster.  You can optionally hide these in the configuration, under Display ("Hide Characters for which we have no data").
• NEW: Added Beastlord support
• NEW: Added support for having both secondary tradeskills
• NEW: Many new fields for your display templates (now over 30 fields to chose from).
• NEW: Presets for display templates.  You can select a set of fields for your roster pages that most closely matches  your guild's playstyle, and edit it further afterward.
• NEW: Race field, with optionally displayed icons done by Seagoat.  Thanks!
• NEW: Implemented config version checking.  You will be pointed back to the configuration page if you try to access a roster which requires you to update your configuration.
• NEW: Option to show/hide the Export (to CSV) link on the menu.  Now disabled by default (unless logged as an admin).
• NEW: Config options that are new or changed since last version will show a flashing red asterisk next to their description on the configuration interface.
• NEW: Added new Top 5 charts to the Guild Summary page (Newest members, Most Kills and Most Deaths).
• IMPROVED: You can have now up to 5 stats pages defined on your roster.
• IMPROVED: When available Curl will automatically be used for fetching data from SOE, otherwise file_get_contents() will be used.
• IMPROVED: Numeric-based grouping: extended status beyond 2.5M, generic ranges used for quests, crafted, harvested, and a few others.
• IMPROVED: Rewrote the CSV generator (for roster export) to be more flexible, more robust, and RFC-compliant.
• IMPROVED: A slight touch of CSS3 on the tooltip popups
• NERFED: In order to make the code easier to maintain, flatfile and PostgreSQL support has been dropped, as they weren't really used anymore, and  MySQL is pretty much the norm with web hosting these days.
• NERFED: Removed the example config.php.dist file, as manually editing this file is no longer recommended due to the large amount of config entries.

View it here.Download it here.RSS Feed here.Discuss it here.

[Finnstang]

I am getting an error when trying to find my Guild ID in the Search popup.  Aegis on Freeport...

Searching... Warning: file_get_contents() [function.file-get-contents]: URL file-access is disabled in the server configuration in /home/xxxxxx/public_html/xxxxxxx.com/forum/rostermaster/rmgetguild.php on line 82 Warning: file_get_contents(http://data.soe.com/xml/count/eq2/guild/?name=i/aegis/&world=Freeport&c:show=id,name&c:sort=name:1) [function.file-get-contents]: failed to open stream: no suitable wrapper could be found in /home/xxxxxx/public_html/xxxxxxx.com/forum/rostermaster/rmgetguild.php on line 82 Parsing error!String could not be parsed as XML in rmgetguild.php:85!

[Lantis]

Finnstang@Kithicor wrote:

I am getting an error when trying to find my Guild ID in the Search popup.  Aegis on Freeport...

Searching... Warning: file_get_contents() [function.file-get-contents]: URL file-access is disabled in the server configuration in /home/xxxxxx/public_html/xxxxxxx.com/forum/rostermaster/rmgetguild.php on line 82 Warning: file_get_contents(http://data.soe.com/xml/count/eq2/guild/?name=i/aegis/&world=Freeport&c:show=id,name&c:sort=name:1) [function.file-get-contents]: failed to open stream: no suitable wrapper could be found in /home/xxxxxx/public_html/xxxxxxx.com/forum/rostermaster/rmgetguild.php on line 82 Parsing error!String could not be parsed as XML in rmgetguild.php:85!

It means your server has disabled this function.  I will have to implement Curl support as well for this section I guess.

Your GuildID is: 4265806579

[Finnstang]

Ahhh...thanks for looking it up.

Next issue...

After saving my config, I test DB connection, and it reports successful, but when I Initialize Database, it says:

Error:Unable to create Main RosterMaster Table

I created a new db user and gave it full access to the database.  Also, I upgraded my RMSA for another server, and get the same message...and that db user/pw has been the same for a couple years and was working in the past.

Any ideas there?

[Lantis]

Finnstang wrote:

Ahhh...thanks for looking it up.

Next issue...

After saving my config, I test DB connection, and it reports successful, but when I Initialize Database, it says:

Error:Unable to create Main RosterMaster Table

I created a new db user and gave it full access to the database.  Also, I upgraded my RMSA for another server, and get the same message...and that db user/pw has been the same for a couple years and was working in the past.

Any ideas there?

I had no issue upgrading two installations here (but I didn't try a completely new installation yet).  I will have to take a closer look when I get home tonight.

Make sure you enable verbose logging in the settings, and see if you get more information when attempting once again to intialize your database.

Note that initializing is only needed for new installations.  For upgrades, just click on the appropriate Upgrade link below (baed on which version you are upgrading from).

What SQL server are you using?

[Finnstang]

Lantis@Antonia Bayle wrote:

Finnstang wrote:

Ahhh...thanks for looking it up.

Next issue...

After saving my config, I test DB connection, and it reports successful, but when I Initialize Database, it says:

Error:Unable to create Main RosterMaster Table

I created a new db user and gave it full access to the database.  Also, I upgraded my RMSA for another server, and get the same message...and that db user/pw has been the same for a couple years and was working in the past.

Any ideas there?

I had no issue upgrading two installations here (but I didn't try a completely new installation yet).  I will have to take a closer look when I get home tonight.

Make sure you enable verbose logging in the settings, and see if you get more information when attempting once again to intialize your database.

Note that initializing is only needed for new installations.  For upgrades, just click on the appropriate Upgrade link below (baed on which version you are upgrading from).

What SQL server are you using?

I will try verbose logging and see if I get any errors...

As far as my upgrade, when I did the upgrade link, that was successful so I then forced an update of the roster data and it gave me an error saying it couldn't write to the database...so in trying to get it working, I created a new user and eventually just blew away my rostermaster tables so then was trying to Initialize then to recreate the tables...again when I do a db test, it says it is successful.

Using MySQL version 5.1.56 if it matters...

K...with Detailed logging on, I don't get any more detailed error on the webpage...and nothing new in error_log in the Rostermaster directory...

[Finnstang]

OK...so I just copied the rmadmin.php file from my backup of the 4.5 version and checked/saved the configuration and then Initialized the DB and it worked...tables have been created.  So it seems something is screwy there...

So tables created...I went to update roster data...complains about config that isn't up to date...I edit/save config again.  Try to update roster data again...now I get this error a bunch of times:

Warning: Illegal offset type in isset or empty in /home/noobher1/public_html/eq2-aegis.com/forum/rostermaster/dkpplugins/dkpdb.php on line 74

and

Error:Unable to write to database!

Went in to Config and set DKP option to None just in case...and now I just get this:

Error:Unable to write to database!

[Finnstang]

Looking now at the logs since the log table is there now...The Guild data has been retrieved...then I get the following errors:

Unable to write to database!

SQL Query: REPLACE roster_master SET name='Powerz', rank='Alt', rank_value='2', adv_Level='90', art_Level='55',

SQL Error: Unknown column 'sects1' in 'field list'

Then a bunch of "user added to local database" messages.

Currently only the roster_log and roster_guild tables have any data in them.

So then I did an update from 4.5 in the config area and then update roster data (figured that unknown column error was dude to that not being in the new version anymore...) and it seems to have actually given me a roster...

Now I have data in my roster_master table as well...

[Finnstang]

BTW, I reenabled DKP and it seems to have updated from my eqdkp just fine...

[Lantis]

So from what I gather, upgrading works fine, it's creating a fresh new database that fails, correct?

And I'm glad to see at least one person who does use the DKP integration   Out of curiosity, do you also use the custom fields?

[Nashbry]

I am doing a new install, I have never used RMSA before -- was able to get my guild's ID but I also get this error when initializing the database:

Error:Unable to create Main RosterMaster Table

When I test the DB connection it states that it is successful so not sure what is wonky--I am only a semi-techy, I can follow instructions and meddle but I do not know enough to troubleshoot the code myself.

My db user has all privileges and my db and db user are correct.

So now I am kind of stuck

Any fix for this?  I am from Freeport so just kind of doing other things during the merge.

SIDENOTE: Fortunately I have played around with enough website CMS's to have figured this out on my own but I had to manually add my database and db user/pw to the config file (I am on shared hosting--uugghh I know) in order to even get to the web version of the config file---might make mention of that in the Install instructions.

[Finnstang]

Lantis@Antonia Bayle wrote:

So from what I gather, upgrading works fine, it's creating a fresh new database that fails, correct?

And I'm glad to see at least one person who does use the DKP integration   Out of curiosity, do you also use the custom fields?

This is my first install of RMSA for this guild...my previous guild we did not use DKP so I had no need of using the plugin with my RMSA install there.  Since we do use eqdkp for my current guild, I figured might as well try out the integration.

I do not currently use custom fields, but again since I am just installing it, I may find a use for them still.

I agree there seems to be some kind of wonkiness with doing the fresh install since I was able to work around it by doing an upgrade.  I also forgot to mention that, like Nashbry mentions above, I also had to manually edit the config file with my databse, db user, and pw info to get to be able to even get to the config screen initially.

[Lantis]

The issue with new installs failing is caused by the removal of the code handling non-SQL based storage.  With that code removed, there is no code left to handle the configuration part before you reach the point where you have a valid config file generated.

I will push out a Beta 2 later tonight that will resolve this issue.  In the mean time, people already fiddling with Beta 1 can manually edit includes/config.php to enter the database parameters near the end of the file, or hang on a few hours for Beta 2.

People upgrading from 4.5.0 should be fine.

Thanks for the reports folks

[Lantis]

RosterMaster StandAlone v5.0.0 Beta 2

(See here for what's new in 5.0.0)

Changes in Beta 2:

• IMPROVED: Better database connection testing/reporting
• IMPROVED: Better error handling when failing to initialize the database.
• FIXED: PHP warning when chosing your initial password
• FIXED: Creation of new database would fail
• MPROVED: Guild ID search will also make use of Curl when available (to work around servers with castrated file_get_contents())

If you are running Beta 1, simply unpack this new version on top of Beta 1.  No changes were made to the database or the config file.

View it here.Download it here.RSS Feed here.Discuss it here.