Welcome Guest ( Log In | Register )

 Forum Rules Joomla Scraper support
 
Reply to this topicStart new topic
> Joomla Scraper Cron Fail
r3d4sh
post Mar 1 2013, 06:06 PM
Post #1


Newbie
*

Group: Members
Posts: 5
Joined: 18-February 13
Member No.: 1,574



Hello,

I do not get to run the cron for joomla joomla aggregator scraper in 3.0.

I followed the steps listed in the post "Cron Jobs Issues".

When I run
Код
http://www.my_site.com/administrator/components/com_aggregator/cron.aggregator.php

the result is:
0 items are imported in 0 seconds.

I uploaded to my server mycron.php file with the contents:

Код
<?php
$a = file_get_contents('http://www.my_site.com/administrator/components/com_aggregator/cron.aggregator.php');
?>


To prove I have done the following:

Код
<?php
$a = file_get_contents('http://www.my_site.com/administrator/components/com_aggregator/cron.aggregator.php');
echo $a;
?>


And the result is also as
Код
http://www.my_site.com/mycron.php

run:
0 items are imported in 0 seconds.

On my server I mycron.php scheduled to run every 5 minutes with the command * / 5 ****.

I have found that this works and that the script is run every 5 minutes.

In component've tried everything:

Код
*/3 * * * *
*3 * * * *


and now I have:

Код
6 0-23 * * *


GET THAT NOT automatically update.

What I have to do? Could you put a detailed manual configuration? Is there a problem with the component for joomla 3.0?

Thank you.


This post has been edited by Web Design Seo: Jan 5 2014, 08:20 AM
Go to the top of the page
 
+Quote Post
Web Design Seo
post Mar 2 2013, 11:52 AM
Post #2


Web Design Seo
****

Group: Root Admin
Posts: 4,162
Joined: 29-April 09
From: Sofia
Member No.: 1



Try to import feed manual first. Keep in mind that items from one feed can be imported only once in joomla. Can be imported again only after 15 min. and only different items (joomla duplicate content protection is based on alias).

If you don't see items with these titles, check again in trash also wink.gif


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
r3d4sh
post Mar 2 2013, 12:08 PM
Post #3


Newbie
*

Group: Members
Posts: 5
Joined: 18-February 13
Member No.: 1,574



I have a feed ready to import multiple news. These news if you look and when I imported the manual process (preview and import), but not with the cronjob. I no longer know what to do.

Greetings.
Go to the top of the page
 
+Quote Post
Web Design Seo
post Mar 4 2013, 07:07 AM
Post #4


Web Design Seo
****

Group: Root Admin
Posts: 4,162
Joined: 29-April 09
From: Sofia
Member No.: 1



Цитат
You must configure cron on two different places:
- in every rss feed in Joomla Scraper configuration (different settings for every feed)
- in cronjob configuration in your hosting control panel (set to run every 2, every 3 or every 5 minutes)

Create file with name mycron.php. Code for this php file:
Код
<?php
$a = file_get_contents('http://yoursite.com/administrator/components/com_aggregator/cron.aggregator.php');
?>



Upload file mycron.php in your public_html. Create cronjob in your cpanel with command:
Код
/usr/local/bin/php -q /relative path to public_html/mycron.php >> /dev/null


Set cron to run in your control panel (cpanel or other) every 5 or 3 minutes (recommended). In Unix Style view this should be:

Код
*/3 * * * *



How to test manual cron?
Set error reporting at maximum:



and open url:
Код
http://yoursite.com/administrator/components/com_aggregator/cron.aggregator.php


If this url is working, problem is not in our component. If cron not work with code posted in this post, contact your host support and ask "is this code correct":
Код
/usr/local/bin/php -q /relative path to public_html/mycron.php >> /dev/null


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
4FootyFans
post Jan 1 2014, 04:53 PM
Post #5


Newbie
*

Group: Members
Posts: 6
Joined: 1-January 14
Member No.: 1,932



Hello

Joomla 2.5.17

I had the same problem so set error reporting to maximum and ran manually.

http://mysite.com/administrator/components/com_aggregator/cron.aggregator.php

The result I received was:

"Notice: Undefined offset: 8 in ........./public_html/administrator/components/com_aggregator/helpers/cron.php on line 186"

for each feed.

This was followed by the actual 8 results.

If I run ......../mycron.php, a blank page is returned. If I run mycron.php via cpanel cron, a null result is returned.

The contents of mycron.php is:

<?php
$a = file_get_contents('http://mysite.com/administrator/components/com_aggregator/cron.aggregator.php');
?>

Could this be a firewall issue

I would appreciate your advice on this issue.

Best

This post has been edited by 4FootyFans: Jan 1 2014, 04:55 PM
Go to the top of the page
 
+Quote Post
Web Design Seo
post Jan 2 2014, 07:59 AM
Post #6


Web Design Seo
****

Group: Root Admin
Posts: 4,162
Joined: 29-April 09
From: Sofia
Member No.: 1



No, this is not a firewall issue. You must confugure every feed to run it in different time (cron part in feed configuration). Than test every feed manual - one by one and without extras that load server (like scraper and download images function).

This topic will help you: http://3dwebdesign.org/forum/server-load-a...a-scraper-t1771 - read from post two.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
4FootyFans
post Jan 2 2014, 12:30 PM
Post #7


Newbie
*

Group: Members
Posts: 6
Joined: 1-January 14
Member No.: 1,932



QUOTE (Web Design Seo @ Jan 2 2014, 07:59 AM) *
No, this is not a firewall issue. You must confugure every feed to run it in different time (cron part in feed configuration). Than test every feed manual - one by one and without extras that load server (like scraper and download images function).

This topic will help you: http://3dwebdesign.org/forum/server-load-a...a-scraper-t1771 - read from post two.


Hi

Yes, thank you. I realised that and have changed the times.

My other issue is that I cannot run the script unless I am already logged into the backend.

Do you have the command or script for including the admin username & password?

I have tried appendiing ?username="username" &password="password" but that does not work.

Thanks

Go to the top of the page
 
+Quote Post
Web Design Seo
post Jan 2 2014, 12:35 PM
Post #8


Web Design Seo
****

Group: Root Admin
Posts: 4,162
Joined: 29-April 09
From: Sofia
Member No.: 1



Cron work without login, only by opening a url address. If you want to run it secure, just change file name from cron.aggregator.php to mysecretlongname.php.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
4FootyFans
post Jan 2 2014, 03:51 PM
Post #9


Newbie
*

Group: Members
Posts: 6
Joined: 1-January 14
Member No.: 1,932



QUOTE (Web Design Seo @ Jan 2 2014, 12:35 PM) *
Cron work without login, only by opening a url address. If you want to run it secure, just change file name from cron.aggregator.php to mysecretlongname.php.



Ok. The problem is that I use Authentication before Admin login.

Is there a way to incorporate the authentication login/password?

Best

Eddie
Go to the top of the page
 
+Quote Post
4FootyFans
post Jan 4 2014, 11:20 PM
Post #10


Newbie
*

Group: Members
Posts: 6
Joined: 1-January 14
Member No.: 1,932



QUOTE (4FootyFans @ Jan 2 2014, 03:51 PM) *
Ok. The problem is that I use Authentication before Admin login.

Is there a way to incorporate the authentication login/password?

Best

Eddie



I have resolved this issue. Thank You........
Go to the top of the page
 
+Quote Post

Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

Collapse

> Similar Topics

  Topic Replies Topic Starter Views Last Action
No new Pinned: Topic has attachmentsJoomla Scraper, Grabber For Joomla
Joomla Scraper Can Grab Any Content From Any Website
82 Web Design Seo 87,855 9th October 2019 - 08:53 AM
Last post by: Web Design Seo
No new Pinned: Topic has attachmentsJoomla Vulnerable Extensions List
list with new Joomla exploits
20 Web Design Seo 25,196 26th September 2018 - 05:07 AM
Last post by: Web Design Seo
No new Pinned: Joomla Pagination Seo Plugin
SEO plugin for Joomla Pagination that work in all Joomla
61 Web Design Seo 65,002 13th March 2018 - 10:05 AM
Last post by: mxcpz
No New Posts Cron Job Working But With Notices
1 Kat 2,034 5th May 2017 - 05:56 AM
Last post by: Web Design Seo
No New Posts Pinned: Joomla Scraper Going Open Source
No licenses, use scraper on unlimited number of web sites
0 Web Design Seo 6,309 8th March 2017 - 07:40 AM
Last post by: Web Design Seo
No New Posts Pinned: Joomla Ден 2016
Joomla Day 2016
1 Web Design Seo 20,358 31st October 2016 - 10:11 AM
Last post by: Web Design Seo
No New Posts Joomla Post By Email To K2 Extra Fields
1 uglykidjoe 13,766 11th February 2016 - 07:45 AM
Last post by: Web Design Seo
No new Pinned: Joomla Scraper Integration With K2
better integration of Joomla Scraper and K2
8 Web Design Seo 25,089 2nd January 2016 - 09:07 AM
Last post by: b_goranov
No New Posts Joomla Scraper Not Working
2 Jan Hädicke 8,280 11th November 2015 - 02:05 PM
Last post by: Web Design Seo
No New Posts Joomla Scrapper Subscription And Licensing Model
3 omoj 8,690 15th October 2014 - 06:06 AM
Last post by: Web Design Seo


 



RSS Lo-Fi Version Time is now: 23rd October 2019 - 12:44 PM
Clicky Web Analytics