Author |
Topic |
|
KCWhiteKnight
Junior Member
USA
202 Posts |
Posted - 12 May 2011 : 06:15:18
|
*First Run* New database - 300 movies inported IMDB Complete Script 999 Actors Set for each movie 6781 Actors Downloaded Every 5th Movie verified back to source data - error rate 0% Movie Information complete No skips - No Missing Actors Average Processing time Actors 3.7 seconds Average Processing time Full Movie and Actors 4 Minutes 19 Seconds. Windows Tweaks - Priority - Real Time\2 of 8 dedicated processing cores.
*Second Run* (currently running - Stats for 189 movies processed) Exisitng database - 400 movies inported IMDB Complete Script 999 Actors Set for each movie 4553 Actors Downloaded * Every 5th Movie verified back to source data - Pending run complete * Movie Information complete - Pending No skips - No Missing Actors * Average Processing time Actors - Pending * Average Processing time Full Movie and Actors - Pending Windows Tweaks - Priority - Real Time\2 of 8 dedicated processing cores.
|
|
|
Alessio Viti
Forum Admin
Italy
9171 Posts |
|
JDommi
Administrator
Germany
4650 Posts |
Posted - 12 May 2011 : 10:03:09
|
It's frustrating... first pass of 50 movies: ok 1 movie manually updated: ok second pass of 200 movies: 12-12-12-12-11-2-2-12-3-1-1-2-2-1-2-1-9-3-3-3-1-2-3-2-2-2-3-1-1 then I have stopped no skip options were activated. |
In order to achieve what is possible, you have to try the impossible over and over again. Hermann Hesse |
|
|
KCWhiteKnight
Junior Member
USA
202 Posts |
Posted - 12 May 2011 : 15:31:53
|
You're welcome. Fortunately I have some software available to me from work that does event tracking. I was trying to see where J might be going slow. I would be glad to work with Music Manager as I have about 500 cds and I was going to look at that once I got my movie database built.
*Second Run* Exisitng database - 400 movies imported IMDB Complete Script 999 Actors Set for each movie 8918 Actors Downloaded Every 5th Movie verified back to source data - Error Rate - 0% Movie Information complete No skips - No Missing Actors Average Processing time Actors - 3.5 Average Processing time Full Movie and Actors - 4 mins. 3 secs. Windows Tweaks - Priority - Real Time\2 of 8 dedicated processing cores.
The slight changes in processing time are due to reponse times. Site busy periods will have an affect on these.
*Third Run* (Just Started) Exisitng database - 500 movies imported IMDB Complete Script 999 Actors Set for each movie Actors Downloaded * Every 5th Movie verified back to source data - Pending run complete * Movie Information complete - Pending * No skips - No Missing Actors * Average Processing time Actors - Pending * Average Processing time Full Movie and Actors - Pending Windows Tweaks - Priority - Real Time\2 of 8 dedicated processing cores.
I'm actually building my final movie database with these runs. While this run is working, I'm going to bring a second pc up online finish tweaking it a little then use that as a tester pc.
Side notes: I am using IMDB movie codes "tt" when I import movies so the search will find the exact movie I want. This works great. Should be a note we add to importing from another software package gives you a clean, fresh build of your movies. You loose a few things like pictures but there are so many scripts in this package you can quickly recover those.
The movies from first run were ran against DVDEmpire for the covers and disk information. The slow part was selecting each movie from the returned list. I believe they function on UPC codes. Once all the movies were selected and download began average processing time was 1.8 seconds per movie. I do have the UPC codes as well and will do a separate test on those. I noticed some of the returned information for this group they didn't match. Like one movie came back with all 1's. I can detail those with a percentage of errors in case people are having problems. It's not the script.
Chad |
Edited by - KCWhiteKnight on 12 May 2011 15:34:15 |
|
|
KCWhiteKnight
Junior Member
USA
202 Posts |
Posted - 12 May 2011 : 16:47:25
|
DVDEmpire Test Results -
I did not download actors. Just did the basic information and disk information such as audio, aspect ratio those things more common to the DVD not found in other places.
I had 11.6% error results in that it could not find the movie. Took those 26 movies and researched them on their site to get the their UPC code listing. Of those 7 came back not found but are on the site. I then took the same 26 movies and tried to download them using another software package that I used to use. Same results. This would make me believe that there is an error somewhere in their search engine. I could add those by title and selecting from the results list. That would be the answer if someone is having issues or problems not getting the information from that site and is NOT the script.
|
|
|
KCWhiteKnight
Junior Member
USA
202 Posts |
Posted - 12 May 2011 : 16:56:18
|
J,
Not sure why you and I aren't matching.
Here's some of my detail:
1. Fresh new full install of EMM lastest version .5 unless Ale slipped one in on me. =) 2. Installed as admin. 3. Created new database. 4. Imported movie codes "tt" 5. I'll use the term added here instead of updating because there isn't any data to go along with the code. 6. Ran IMDB Complete at 999 7. Script Changes a. Not importing Subtitles b. Not importing Studios since I perfer getting those from DVDEmpire since those are normally the main studio and not the vanity studios. c. Not taking year into title d. Not taking AKA Titles.
I do take comment 1 but really don't use it.
Are you updating information or downloading fresh for each movie? Do you always just take the actors from IMDB? (I ask that because I think I stumbled onto something else which might not be related to this. I haven't gotten all the facts together yet to ask questions just observations.)
|
Edited by - KCWhiteKnight on 12 May 2011 17:02:20 |
|
|
Prinz
Senior Member
Germany
1522 Posts |
Posted - 12 May 2011 : 17:04:57
|
quote: Originally posted by KCWhiteKnight
DVDEmpire Test Results -
I did not download actors.
Because there is nothing to download on that site. |
|
|
JDommi
Administrator
Germany
4650 Posts |
Posted - 12 May 2011 : 17:11:57
|
I do an update only on director and actors. I have deleted them all before. In table movies as well as complete table actors! I have all custom8 fields filled. It must depend on a memory leak because when restarting XMM and in some cases XP itself the actors are imported correctly again! The problem is that as I wrote on last post not all actors are imported sometimes. |
In order to achieve what is possible, you have to try the impossible over and over again. Hermann Hesse |
Edited by - JDommi on 12 May 2011 17:13:12 |
|
|
KCWhiteKnight
Junior Member
USA
202 Posts |
Posted - 12 May 2011 : 17:30:46
|
I understand. I was going to try and match what you were doing to see if I could recreate the situation here. You might be on to some thing with the memory. I've noticed that I delete the actors like you and click on a movie either above it or below it in the table it still shows the actors in the movie card. Wasn't some thing I thought much about figured it was a refresh issue and didn't focus on that.
DVDEmpire does have actors whether it's scripted for not. Mostly the lead actors. http://www.dvdempire.com/Exec/v4_item.asp?item_id=1568964
|
|
|
JDommi
Administrator
Germany
4650 Posts |
Posted - 12 May 2011 : 18:47:40
|
Please have a look at this movie "Hi- Hi- Hilfe". I can't add the actors to it. The imdb link is http://akas.imdb.com/title/tt0059260 All the time I get John Lennon and Paul McCartney. But the last one breaks the further download and isn't added to the database.
*Edit* When I add PMcC manually and import by imdb(actors) then on next try to import the next actor is added... but only one! Additional: the pic of PMcC isn't added! |
In order to achieve what is possible, you have to try the impossible over and over again. Hermann Hesse |
Edited by - JDommi on 12 May 2011 19:01:02 |
|
|
Prinz
Senior Member
Germany
1522 Posts |
Posted - 12 May 2011 : 19:01:33
|
quote: Originally posted by KCWhiteKnight
DVDEmpire does have actors whether it's scripted for not. Mostly the lead actors. http://www.dvdempire.com/Exec/v4_item.asp?item_id=1568964
Yes of course but without any data and there are imported as empty actors. |
|
|
JDommi
Administrator
Germany
4650 Posts |
Posted - 12 May 2011 : 19:15:29
|
I think it's related with the "()". After adding all 4 Beatles manually the other actors are imported correctly! |
In order to achieve what is possible, you have to try the impossible over and over again. Hermann Hesse |
|
|
Prinz
Senior Member
Germany
1522 Posts |
Posted - 12 May 2011 : 19:31:21
|
quote: Originally posted by JDommi
Please have a look at this movie "Hi- Hi- Hilfe". I can't add the actors to it. The imdb link is http://akas.imdb.com/title/tt0059260 All the time I get John Lennon and Paul McCartney. But the last one breaks the further download and isn't added to the database.
That is a Bug in the
#OPENWEBSLOT1#
Function. The Function simply doesn't download anything at some point and jumps out of the magic script block.
I always said the the webslot download functions didn't have a correct error handling. If something goes wrong with these webslots the functions don't work anymore until you restart XMM. |
|
|
Prinz
Senior Member
Germany
1522 Posts |
Posted - 12 May 2011 : 19:43:37
|
quote: Originally posted by JDommi
I think it's related with the "()". After adding all 4 Beatles manually the other actors are imported correctly!
I don't think so. Just test imported: http://akas.imdb.com/title/tt0337563
That movie has multiple actors with () and all are imported. |
|
|
JDommi
Administrator
Germany
4650 Posts |
Posted - 12 May 2011 : 19:52:30
|
Then I'm really all at sea...................................... |
In order to achieve what is possible, you have to try the impossible over and over again. Hermann Hesse |
|
|
Prinz
Senior Member
Germany
1522 Posts |
Posted - 12 May 2011 : 19:59:44
|
Like i said, with your movie the actor import stops when the next actor page should be downloaded with the #OPENWEBSLOT1# function. Instead of downloading the page the function simply jumps out of the actors Block and doesn't work anymore until you restart XMM. |
Edited by - Prinz on 12 May 2011 20:00:13 |
|
|
JDommi
Administrator
Germany
4650 Posts |
Posted - 12 May 2011 : 20:04:41
|
<-- cry baby: AAALLLLEEEEEE!!!!!!!!!!! |
In order to achieve what is possible, you have to try the impossible over and over again. Hermann Hesse |
|
|
KCWhiteKnight
Junior Member
USA
202 Posts |
Posted - 12 May 2011 : 20:50:48
|
Oh Iquote: Originally posted by Prinz
quote: Originally posted by KCWhiteKnight
DVDEmpire does have actors whether it's scripted for not. Mostly the lead actors. http://www.dvdempire.com/Exec/v4_item.asp?item_id=1568964
Yes of course but without any data and there are imported as empty actors.
Oh I totally agree. That's why I don't download from. Far from complete listing of anything. Also noticed they have typos and different spellings on some names. When I get back to writing documentation I was going to recommend skipping that as part of explaining the check boxes for new users. |
|
|
KCWhiteKnight
Junior Member
USA
202 Posts |
Posted - 12 May 2011 : 21:54:57
|
Row the boat back this way to land. LOL I got it to recreate. I was looking at your ( question and noticed that it seemed to work on situations where you have as AKA for names. Also reviewed the TV part for the number of shows they were in which was also in ( ).
Here's what I have so far.
New builds with dowloading all information works great so far. Fingers crossed. I'm at almost 900 movies and 27,831 actors. All information is correct and stored.
When I take a test database (running on the second pc) delete the actors like we've talked about following your specs of actors and directors and running an update - I can get 5 to 10 movies to update before the skip starts. Sometimes one and two actors before it jumps. When the update is done and I try to restart it does not update the movie again. Like Prinz said you have to restart EMM to restart.
There seems to be a difference between add and updating. Logically, I would think why does the program care. I would think it's the same process unless something is left behind or not reindexed when we delete the actors.
|
|
|
KCWhiteKnight
Junior Member
USA
202 Posts |
Posted - 13 May 2011 : 04:40:53
|
Okay, if we focus on just the movie J was trying to work with the Beatles Help!
New Database 0 movies
Added Help! by title. Update using Complete. Not found in the search. Added Help! by tt code Update using complete. Found and Started Downloading.
Down loaded John and Paul for actors. Looking at the movie detail John and Paul are listed correctly in Starring Tab as John (as the Beatles) and Paul (as the Beatles).
Close EMM. Restart and tried to update and failed. Okay, shut down and restart PC then restart EMM another failure.
Delete database to try again.
Added Help! via tt code same results I got John and Paul. Same information under the starring tab in movie detail.
Then I noticed something really odd. John is the actor database with full details and Paul is nowhere to be found but is listed in the movie detail. It would appear that his data never made it over to the actor's side. It looks like it got collected from the Paul (as the Beatles) but the write failed.
I found seven other movies with a character like '!' or '?' in the title thinking perhaps that might be it. They worked fine and downloaded all actors.
Focusing just on the download for Paul and watching the script editor seems there something happening just before or around take pic.
Sorry sneezed and posted without finishing.
At that point it jumps out of the actors section and continues on with the script. But it has collected a lot of information before hand and processed never appears to write it. I just noticed a couple of line items that looked different but it goes so fast and I don't know how to set break points as yet. It appears in the same area each time even after restarting EMM, deleting all actors or a total reboot.
I can never get past that to automatically load the rests of the actors. J and I have restarted and be able to finish the download for other movies but on this one it's consistant.
Yes I can manually add them as well. If I add Paul and then update from the web using the Actors IMDB script. It imported Films, date of birth, place of Birth. Did not load Bio, Trivia, Awards or Pictures.
So if one of you guys with more experience than me with this could look at it and see if you see anything strange that would be great =)
Thanks, Chad |
Edited by - KCWhiteKnight on 13 May 2011 05:07:19 |
|
|
Topic |
|
|