BinaryWorks.it Official Forum
BinaryWorks.it Official Forum
Home | Profile | Register | Active Topics | Members | Search | FAQ
Username:
Password:
Save Password
Forgot your Password? | Admin Options

 All Forums
 eXtreme Movie Manager 8, 9, 10 Forum
 Bug Reports
 IMDB script does not work correctly
 New Topic  Reply to Topic
 Printer Friendly
Previous Page | Next Page
Author  Topic Next Topic
Page: of 15 Lock Topic Edit Topic Delete Topic New Topic Reply to Topic

bigmechax
Starting Member

19 Posts

Posted - 08 Jan 2023 :  04:17:36  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Hi there

I have been using Extreme Movie Manager 9.0 and Extreme Movie Manager 10.x and find that both are not getting either media info for Movies or TV Series. Extreme Movie Manager 10.x works better than 9.0. I have found that some times the script for Themoviedb.org works better for Movies and TV Series and than the script for IMDB for Movies and TV Series.

I noticed the IMDB script for Movies or TV Series wasn't doing the right or correct get media info. Yes, IMDB seems to have changed access to their website.

Is there any help you can give ?

As of 1/19/2023... I'm using Extreme Movie Manager 10.0 and the TV series script is not working correctly. It doesn't grab the plot or synopsis information at all. Also, I'm using

Date : 21/November/2018 -
- Comments : Import All Information available -
- of Series and Episodes -
- "GOSUB" : Code and Idea by JDommi -
------------------------------------------------
#MADEBY#=Aletsg
#DATEBUILD#=2021-07-26 - 11:36
#WEBSITE#=IMDB.COM
#NOTE#=Import some Episodes Info
#SCRIPTQUALITY#=5
#REPLACESPACES#=+
#SCRIPTGENERATION#=3
#TVSERIES#=TRUE

and the April 2022 tv script for/from IDMB

Check the picture out...

[url=https://ibb.co/D599xP5][/url]
[url=https://imgbb.com/]free no registration[/url]

Edited by - bigmechax on 20 Jan 2023 04:55:33
Go to Top of Page

JDommi
Administrator

Germany
4650 Posts

Posted - 08 Jan 2023 :  12:07:56  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
I will try to find what's changed this time... next week.

In order to achieve what is possible, you have to try the impossible over and over again.
Hermann Hesse
Go to Top of Page

Kipcior
New Member

78 Posts

Posted - 08 Jan 2023 :  22:27:11  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Although I am not using the same script as JDommi shared, basically because I made my own changes at some point to remove some parts and make it lighter and up to my needs but still after I modified weblink to search (provided by JDommi) and included it into my script, it is working fine since then and still today (just downloaded all the info of Black Adam). The only thing is that indeed, it does not search and show the movies list but instead i need to provide imdb ttxxxxxx number as a search term, and then it works fine finding it and scrapping all the information I need. It also derives actors/crue and adds them to the movie however not all the information of each person is added with this script, therefore I additionally used my own actors script to add missing info for newly added people - it is very limited though due to the database size limit. This actors' script unfortunately stopped working as well in December and I will be working on fixing it coming days. If anyone is interested (taking into account it's limitations) I am happy to share.
Go to Top of Page

JDommi
Administrator

Germany
4650 Posts

Posted - 09 Jan 2023 :  15:35:49  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Well, there is one little change in line 1005 to make to the script to get the list back again.
previously:

    #FIND#=<div class="sc-17bafbdb-4 hCrApe">#22#	//end of result list
    #LOADCURSOR#=#23#

:LOOPNEXTMOVIE

to now:

    #FIND#=<!-- Begin INLINE40 -->#22#	//end of result list
    #LOADCURSOR#=#23#

:LOOPNEXTMOVIE


On the actor's info I will start to work tomorrow!

In order to achieve what is possible, you have to try the impossible over and over again.
Hermann Hesse
Go to Top of Page

Alferio
Starting Member

35 Posts

Posted - 09 Jan 2023 :  21:51:17  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
I've modified the script with the solution suggested by jdomi but doesn't work
Go to Top of Page

JDommi
Administrator

Germany
4650 Posts

Posted - 09 Jan 2023 :  22:16:27  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Did you have changed the #FIND# command with the correct expression? No typo?
For me XMM shows the movie results correctly again. I have tested it with Turbulence and Wishmaster.

In order to achieve what is possible, you have to try the impossible over and over again.
Hermann Hesse
Go to Top of Page

Alferio
Starting Member

35 Posts

Posted - 09 Jan 2023 :  22:19:35  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
I did a simple copy and paste not understanding anything about scripts ... I'll try again tomorrow
Go to Top of Page

JDommi
Administrator

Germany
4650 Posts

Posted - 10 Jan 2023 :  18:33:47  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Release 4: https://www.mediafire.com/file/by5521t7sonb64m/IMDB.COM_2023_%2528Complete%2529%25284%2529.txt/file

The first fixes for people info:
Photo
Birthday and place
Deathday and place
Country
Alternate names
Sex (only for actor/actress)

Edit:
@Kipcior
Maybe we could combine the scripts and check which blocks can be optimized
Especially the IMDB (Complete) script has such an amount of used variables...
Beside that the script really needs a short documentation as not every routine has it's own block. And the complete people info as a subroutine needs a list of variables that must not be changed inside.

In order to achieve what is possible, you have to try the impossible over and over again.
Hermann Hesse
Go to Top of Page

Alferio
Starting Member

35 Posts

Posted - 10 Jan 2023 :  19:30:38  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
No way. Even with the new script it doesn't give me the movie list. I can overcome the problem by typing the name of the movie as ttxxxx in the search. In that case it downloads all the information to me.
Go to Top of Page

JDommi
Administrator

Germany
4650 Posts

Posted - 10 Jan 2023 :  21:49:07  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Strange, for me the search is working...
Unfortunately I can't fix something that is working for me. Maybe Kipcior has a solution or an idea?!?
Or - IMDB is still changing the structure from country to country.

I would suggest to start my debugger and perform a search for a specific movie. Then you can send me the loaded result page out of the debugger. That way I can compare the website with my own. The way via my debugger is recommended as IMDb generates country specific output.

By the way I'm using XMM 10.0.0.2!

In order to achieve what is possible, you have to try the impossible over and over again.
Hermann Hesse
Go to Top of Page

Alferio
Starting Member

35 Posts

Posted - 10 Jan 2023 :  21:58:37  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Ok. I'll try tomorrow . I'm using the 9.1.2 version cause is the only version available in 64 bit. The 10 version is only 32 bit and i have problem with the dimension of my database. However tha most important thing is that the new script allows to download the information using ttxxxxm.
Go to Top of Page

Kipcior
New Member

78 Posts

Posted - 11 Jan 2023 :  23:11:25  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Sorry, I was away for some time. Anyhow, here is my script which creates movie list. There were few things I needed to change there, not only when the list starts and ends but also as it occured, in the previous version there was always img tag in html, while now for the movies without a small picture, there is no such tag (there's svg instead if I recall) so at some point the script were in the constant loop because was always coming back to the previous movie with the picture. They also changed from table to list tags. And what does not work for me sometimes, using old script is #FINDLINE# tag which does not work when searched string is within the line that I'm already in with the cursor. In the old page, movies were in separate lines while now whole list is in one line. Changeing to #FIND# fixes it. Anyhow, this is my block for Movielist creation which works at this point:

#CREATEMOVIELIST#
#PUT#=0#17#
#PUT#=0#18#
#PUT#=1#01#
#PUT#=2#02#
#PUT#=3#03#
#PUT#=0#04#
#WRITEWARNING#= The script will import #92# Actors, can be really SLOW!!
#WRITEWARNING#= (If you want import less actors go in the advanced configuration of script)
#STARTREADWEB#
#FINDLINE#=Titles</h3>#23##ONERROR#=*OK*
#IF# #23#==#00#
#GOTO#=NOTHINGFOUND
#ENDIF#
#FIND#=<li class="ipc-metadata-list-summary-item#23##ONERROR#=*OK*
#IF# #23#==#00#
#GOTO#=NOTHINGFOUND
#ENDIF#

:REPEATSEARCH
#PUTCURSOR#=#01#
#FIND#=<span class="ipc-see-more results-section-see-more#11# #ONERROR#=*OK*
#IF# #11#==#00#
#PUT#=1000000#11#
#ENDIF#
#LOADCURSOR#=#01#

:REPEATMTITLES
#FIND#=</div></div></li>#10# #ONERROR#=*OK*
#PUTCURSOR#=#01#
#FINDPREVIOUS#=<img alt="#10# #ONERROR#=*OK*
#IF# #10#<<#04#
#LOADCURSOR#=#01#
#PUT#=0#04#
#PUT#=0#05#
#PUT#=0#08#
#FINDPREVIOUS#=<li class="ipc-metadata-list-summary-item#10# #ONERROR#=*OK*
#GOTO#=NOIMAGE
#ENDIF#
#FIND#=src="#04# #ONERROR#=*OK*
#FIND#="#04# #ONERROR#=*OK*
#COMPUTECURSOR#=+1
#FIND#="#05# #ONERROR#=*OK*
#TAKEWORD#=#08#,#04#,#05#

:NOIMAGE

#FIND#=href="/title#10# #ONERROR#=*OK*
#IF# #10#<>#00#
#FIND#=/#10# #ONERROR#=*OK*
#FIND#=/?ref_=#03# #ONERROR#=*OK*
#FIND#=>#04# #ONERROR#=*OK*

#FIND#=</a><ul class="#12# #ONERROR#=*OK*
#LOADCURSOR#=#04#
#FIND#=</a>#05# #ONERROR#=*OK*

#IF# #12#==#00#
#STRING#=#12#=#11#
#ENDIF#

#IF# #12#<<#05#
#STRING#=#05#=#12#
#ENDIF#
#TAKEWORD#=#06#,#10#,#03#
#TAKEWORD#=#07#,#04#,#05#
#CHECKVARIABLE#=#07#
#CLEARTAGS#
#STARTDELETETAGS#
#STARTSUBSTITUTETAGS#
#IF# #75#>>#00#
#FINDPREVIOUS#=(Video Game#12#
#LOADCURSOR#=#05#
#IF# #12#>>#04#
#GOTO#=SKIPVG
#ENDIF#
#FINDPREVIOUS#=(Podcast Episode#12#
#LOADCURSOR#=#05#
#IF# #12#>>#04#
#GOTO#=SKIPVG
#ENDIF#
//#FINDPREVIOUS#=(TV Episode#12#
//#LOADCURSOR#=#05#
//#IF# #12#>>#04#
//#GOTO#=SKIPVG
//#ENDIF#
#FINDPREVIOUS#=(TV Series#12#
#LOADCURSOR#=#05#
#IF# #12#>>#04#
#GOTO#=SKIPVG
#ENDIF#
#ENDIF#
#WRITETITLELIST#=https://www.imdb.com/#06#/ ---> #07# §#08#
:SKIPVG
#ENDIF#
#IF# #10#==#00#
#GOTO#=ENDLIST
#ENDIF#
#FIND#=</div></div></li>#10# #ONERROR#=*OK*
#COMPUTECURSOR#=+1
#PUTCURSOR#=#01#
#FIND#=href="/title#10# #ONERROR#=*OK*
#LOADCURSOR#=#01#
#IF# #10#==#00#
#GOTO#=ENDLIST
#ENDIF#
#IF# #10#<<#11#
#GOTO#=REPEATMTITLES
#ENDIF#

:ENDLIST
#GOTO#=ENDCREATEMOVIELIST

:NOTHINGFOUND
// No titles were found
#WRITETITLELIST#= ~~~~~~~~ The script couldn't find any titles matching that name. ~~~~~~~~
#WRITETITLELIST#=
#WRITETITLELIST#= If you know an alternative name for this movie then you could try to enter it
#WRITETITLELIST#= again and after make import again
#WRITETITLELIST#=
#WRITETITLELIST#= If it still doesn't find anything then try to go to this page and search for it manually:
#WRITETITLELIST#= https://www.imdb.com/search
#WRITETITLELIST#=
#WRITETITLELIST#= If you could find it manually then please post a bugreport in this thread in the XMM forum:
#WRITETITLELIST#= http://www.binaryworks.it/forum/topic.asp?TOPIC_ID=772
:ENDCREATEMOVIELIST
#ENDCREATEMOVIELIST#


P.S.

JDommi 0 I am happy to work on the script together. Still not all things are working for me and some blocks are not trigerred for some reason so exchanging experience and building universal script would be good idea. Let me know to priovate email and we can create a project on github.


Edited by - Kipcior on 11 Jan 2023 23:13:46
Go to Top of Page

JDommi
Administrator

Germany
4650 Posts

Posted - 12 Jan 2023 :  16:06:31  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Nearly done :)
I have to fix
Spouse, birth name, bio, filmography and awards - where the last 2 will "waste" a lot of bytes in the database table.
Beside that I have to check against non existent info so that the specific subroutine doesn't break the info.

In order to achieve what is possible, you have to try the impossible over and over again.
Hermann Hesse
Go to Top of Page

Alferio
Starting Member

35 Posts

Posted - 12 Jan 2023 :  18:19:29  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Great Kipcior. It works.

Edit
Except year relaese

Edited by - Alferio on 12 Jan 2023 19:01:30
Go to Top of Page

JDommi
Administrator

Germany
4650 Posts

Posted - 13 Jan 2023 :  15:39:20  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
https://www.mediafire.com/file/38fvjz33vjh6wca/IMDB.COM_2023_%2528Complete%2529%25285%2529.txt/file

Should take all info except the actor's bio page...


Please check this part:

--MOVIE LIST--------------------------------------------------------------------------------
#CREATEMOVIELIST#
    #PUT#=0#17#
    #PUT#=0#18#
    #PUT#=1#01#
    #PUT#=2#02#
    #PUT#=3#03#

    #WRITEWARNING#= The script will import #92# Actors, can be really SLOW!!
    #WRITEWARNING#= (If you want import less actors go in the advanced configuration of script)

    #STARTREADWEB#
    #FINDLINE#=<li class="ipc-metadata-list-summary-item#23# #ONERROR#=*OK*	//start of result list
    #IF# #23#==#00#
        #GOTO#=NOTHINGFOUND
    #ENDIF#

:LOOPNEXTMOVIE 
    #FIND#=li class="ipc-metadata-list-summary-item#17# #ONERROR#=*OK*	//start of entry
    #IF# #17#==#00#
        #GOTO#=ENDCREATEMOVIELIST
    #ENDIF#
    #FIND#=<div class="ipc-metadata-list-summary-item__cc">#18#	//end of entry
    #LOADCURSOR#=#17#

    //get cover pic #04#
    #PUT#=#04#
    #FIND#="lazy"#11# #ONERROR#=*OK*	//cover is available
    #IF# #11#>>#18#
        #LOADCURSOR#=#17#
        #GOTO#=NOCOVERFORMOVIELIST
    #ENDIF#
    #IF# #11#==#00#
        #LOADCURSOR#=#17#
        #GOTO#=NOCOVERFORMOVIELIST
    #ENDIF#
    
:COVERFORMOVIELIST 
    #FIND#=src="https://m.media#11#
    #FIND#="#11#
    #FIND#=.jpg#12#
    #FIND#="#12#
    #TAKEWORD#=#04#,#11#,#12#
:NOCOVERFORMOVIELIST 

    //get link to page #05#
    #FIND#=href="/title/#11#
    #FIND#="#11#
    #FIND#=?ref#12#
    #TAKEWORD#=#05#,#11#,#12#

    //get movie title #06#
    #FIND#=>#11#
    #FIND#=<#12#
    #TAKEWORD#=#06#,#11#,#12#

    //get movie year #07#
    #FIND#="_blank">#11#
    #FIND#=>#11#
    #FIND#=<#12#
    #TAKEWORD#=#07#,#11#,#12#

    //get 2 actors #08#
    #FIND#="_blank">#11#
    #FIND#=>#11#
    #FIND#=<#12#
    #TAKEWORD#=#08#,#11#,#12#

    #STRING#=#06#=#06# (#07#) [#08#]
    #PUT#=TV Series#14#
    #IF# #08#==#14#
        #GOTO#=NOOUTPUT
    #ENDIF#
    #PUT#=TV Episode#14#
    #IF# #08#==#14#
        #GOTO#=NOOUTPUT
    #ENDIF#
    #PUT#=Video Game#14#
    #IF# #08#==#14#
        #GOTO#=NOOUTPUT
    #ENDIF#
    #PUT#=TV Mini Series#14#
    #IF# #08#==#14#
        #GOTO#=NOOUTPUT
    #ENDIF#
    #PUT#=Podcast#14#
    #IF# #08#==#14#
        #GOTO#=NOOUTPUT
    #ENDIF#
    #PUT#=Podcast Episode#14#
    #IF# #08#==#14#
        #GOTO#=NOOUTPUT
    #ENDIF#
    #PUT#=Music Video#14#
    #IF# #08#==#14#
        #GOTO#=NOOUTPUT
    #ENDIF#	
    #PUT#=Short#14#
    #IF# #08#==#14#
        #GOTO#=NOOUTPUT
    #ENDIF#	
	#CHECKVARIABLE#=#06#
	#STARTSUBSTITUTETAGS#

    #WRITETITLELIST#=https://www.imdb.com/#05#?ref_=fn_al_tt_1 ---> #06#  §#04#
:NOOUTPUT 
    #LOADCURSOR#=#18#
    #GOTO#=LOOPNEXTMOVIE

:NOTHINGFOUND 
    // No titles were found        
    #WRITETITLELIST#= ~~~~~~~~   The script couldn't find any titles matching that name.   ~~~~~~~~
    #WRITETITLELIST#= 
    #WRITETITLELIST#= If you know an alternative name for this movie then you could try to enter it
    #WRITETITLELIST#= again and after make import again                            
    #WRITETITLELIST#=  
    #WRITETITLELIST#= If it still doesn't find anything then try to go to this page and search for it manually:
    #WRITETITLELIST#= https://www.imdb.com//search   
    #WRITETITLELIST#= 
    #WRITETITLELIST#= If you could find it manually then please post a bugreport in this thread in the XMM forum:
    #WRITETITLELIST#= http://www.binaryworks.it/forum/topic.asp?TOPIC_ID=772 
:ENDCREATEMOVIELIST 
    #PUT#=0#00#
#ENDCREATEMOVIELIST#

In order to achieve what is possible, you have to try the impossible over and over again.
Hermann Hesse
Go to Top of Page

JDommi
Administrator

Germany
4650 Posts

Posted - 14 Jan 2023 :  11:48:30  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Everything works (at least for me ) except of Actor's Family, Actor's Filmography and Actor's Awards

https://www.mediafire.com/file/6qp10k2kaov1r9z/IMDB.COM_2023_%2528Complete%2529%25286%2529.txt/file

@Kipcior
Did my mail arrive?

In order to achieve what is possible, you have to try the impossible over and over again.
Hermann Hesse
Go to Top of Page

Alferio
Starting Member

35 Posts

Posted - 14 Jan 2023 :  16:15:34  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
And trailer ... but it's not important
Go to Top of Page

JDommi
Administrator

Germany
4650 Posts

Posted - 14 Jan 2023 :  17:15:19  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Well, trailers I have totally forgotten
But does it work now for you, too, Alferio?

In order to achieve what is possible, you have to try the impossible over and over again.
Hermann Hesse
Go to Top of Page

Alferio
Starting Member

35 Posts

Posted - 14 Jan 2023 :  17:35:01  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Yes it works perfectly ... thanksssssss
Go to Top of Page

JDommi
Administrator

Germany
4650 Posts

Posted - 14 Jan 2023 :  18:12:46  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Great Then I will work on the rest next week...

Btw. what about the TV Series script? Was that broken, too?

In order to achieve what is possible, you have to try the impossible over and over again.
Hermann Hesse
Go to Top of Page
Page: of 15  Topic Next Topic   Lock Topic Edit Topic Delete Topic New Topic Reply to Topic
Previous Page | Next Page
 New Topic  Reply to Topic
 Printer Friendly
Jump To:
BinaryWorks.it Official Forum © Binaryworks.it Go To Top Of Page
Generated in 0.14 sec. Powered By: Snitz Forums 2000 Version 3.4.07