Web sources framework, Using different sites as tagging soures Options

[Florian]

Hello!

The latest Development Build of Mp3tag features a web sources framework which allows tagging via almost any website which offers album information. Please note, that this part is still in beta stage.

To import tags from a website, a web source description file is needed, which contains general information about the source as well as parser scripts which are responsible for parsing the right data out of the WWW sites.

I've written the web source description file discogs.src as an example how to use this framework and hopefully some of you will pick up the idea and write a source description file for e.g. Amazon or a Lyrics site.

Please have a look at this brand-new help topic for documentation of the web source description file format and please don't hesitate to ask, if you have any questions!

Hope you'll like it and use it, because it was a lot of work to implement this!

Best regards,
~ Florian

This post has been edited by dano: Aug 4 2009, 13:51

[Florian]

The new feature is available via the toolbar drop-down menu on the freedb toolbar icon. Please have a look at the screenshot

Best regards,
~ Florian

Attached thumbnail(s)

 

[Florian]

Please let me know, if you've developed a custom web source description file

Best regards,
~ Florian

[Florian]

I've just created the Web Sources Archive with a brand-new AMG web source (which was contributed by an user of Mp3tag).

Enjoy

[vitamin]

Hi,

I just tested the new feature and I am impressed one more time . Seems like all three web sources are working well.

There are some things that catched my eye on this feature:

- When non-standard tags are shown (like "style" in the allmusic dialog) it would be nice to be able to choose whether to use/tag them ore not
Now that I think about it - maybe this would be nice for the FreeDB dialog as well in case you already have tags and only want to modify certain tags (with checkboxes in the columns or something).
If this doesn't fit into the gui for usability reasons you could still add an option like "never use non-standard tags" to the preferences.
Hmm - I think there was some reson why existing tags are deleted before tagging from freedb but can't think of it right now?! Modifying the .src files doesn't seem too easy on first sight...

-I like the feature to safe the album art as files since I like this better then to tag it to the music file (I didn't try Sebastians amazon tool yet). In the safe dialog it would be nice to be able to use variables like "%_directory%". Of course other variables like %album% would only work on the second go if no tags are initially present.

-As I have mentioned a while ago I would like to have a feature like "always write leading zeros for the track tag" in the preferences to safe one step in the tag editing. This came to my attention again when AMG didn't write leading zeros.
For some reason the freedb uses leading zeros when the track number tag had leading zeros before, the web sources seem always to use no leading zeros.

-maybe the "freedb" menu item should be renamed to "web sources" or something.

Thanks again for another nice feature!

best regards,
Vitamin

This post has been edited by vitamin: Feb 9 2005, 01:34

[Dagon]

Hi all,
only a question, can i use amazing "web sources" thought a proxy?

regard
Antonio

[Florian]

Hi all,
only a question, can i use amazing "web sources" thought a proxy?

regard
Antonio

Antonio,

I'll add proxy support to the next release! I simply forgot it

Best regards,
~ Florian

[BLKMGK]

Would it be possible to search multiple sites or a list of sites in a serial fashion in case one site had no data?

FWIW- I've been using this feature EXTENSIVELY sorting out 400Gig of music and adding album art for nearly all of it. With all of the sources now listed there's VERY few albums I cannot get art for. This makes your program head and shoulders over any other IMO. Few programs make tracking this information down this easy or have so many sources. A VERY big thanks!

This post has been edited by BLKMGK: Apr 15 2006, 15:54

[Underthebridge]

BLKMGK that is basically the same feature I am hoping for, which is the ability to parse different html index pages.
This may be accomplished, for example, by adding some command to change [IndexUrl] (and then of course refreshing the html page)

The advantages i see are this:
- Allows joining of multiple site search results
- Solves the problem if the album list page can't be obtained in a single search link
- Allows album list display method to be manipulated before it is actually displayed (like i can arrange the albums by date on the site first)
- Many other possibilites

oh how i badly desire this

[eric00000007]

Wish list
- Allows joining of multiple site search results
- Solves the problem if the album list page can't be obtained in a single search link
- Allows album list display method to be manipulated before it is actually displayed (like i can arrange the albums by date on the site first)
- urlencoding function for search entry
- regex for search entry
- better documentation for src framework (tags names, functions, examples, ...)
- proxy support
- multiple cover art update or add

Thanks for this great tool

This post has been edited by eric00000007: Sep 3 2007, 08:13

[chrisjj]

> - better documentation for src framework (tags names, functions, examples, ...)

Seconded. E.g. "Web Sources Framework" should say how/where to install a description file.

BLKMGK, you say

> I've been using this feature EXTENSIVELY sorting out 400Gig of
> music and adding album art for nearly all of it.

Can I ask: did you do this one album at a time? E.g. for each album, you import/select just its tracks?

Or is there a way to do albums in bulk?

This post has been edited by chrisjj: Apr 3 2010, 18:24

[pone]

just a little question:
is there a name for the program language used for the web source scripts?
maybe i can use my acquired knowlegde for a job application, but i need to know the name.

[Victor Kostas]

Hi Florian,

I think it is a good idea to introduce some king of INCLUDE <filename>.<include extension> command so certain code can be reused in Web Source files (.src).

I have mention this idea in Web Source Framework Discussion topic.
E.g. add following block to a separate file.

CODE

# Album
outputto "Album"
findline "class=\"profile"
findline "href=\"/artist"
regexpreplace "^.+</a>" "</a>"
findinline "</a>"
findinline " - "
sayuntil "</h1>"

INCLUDE this file in .src file. Changing included file would affect all related .src files.

Thank you,
Victor

[chrisjj]

I think it is a good idea to introduce some king of INCLUDE <filename>.<include extension> command so certain code can be reused in Web Source files (.src).

Export configs too.

[simple]

Hi,
Is it possible to assign multiple value to a multivalue field using the Web sources Framework?
Let's take the Genre Field an an Example: If I manually set the the genre of a track to genre1\\genre2, both genres are saves as individual values and can e.g. be used for grouping in players that support multivalue fields. But I wasn't able to achieve the same effect using the Web sources Framework. outputto "Genre" say "genre1\\genre2" just writes the backslashes to a single genre field (even If I use 4 backslashes because they are Escape Characters). It there another solution?
Thanks for your Reply,
Simon

This post has been edited by simple: Oct 29 2011, 15:24