Joomla Scraper Cron Fail Options

[r3d4sh]

Hello,

I do not get to run the cron for joomla joomla aggregator scraper in 3.0.

I followed the steps listed in the post "Cron Jobs Issues".

When I run

Код

http://www.my_site.com/administrator/components/com_aggregator/cron.aggregator.php

the result is:
0 items are imported in 0 seconds.

I uploaded to my server mycron.php file with the contents:

Код

<?php
$a = file_get_contents('http://www.my_site.com/administrator/components/com_aggregator/cron.aggregator.php');
?>

To prove I have done the following:

Код

<?php
$a = file_get_contents('http://www.my_site.com/administrator/components/com_aggregator/cron.aggregator.php');
echo $a;
?>

And the result is also as

Код

http://www.my_site.com/mycron.php

run:
0 items are imported in 0 seconds.

On my server I mycron.php scheduled to run every 5 minutes with the command * / 5 ****.

I have found that this works and that the script is run every 5 minutes.

In component've tried everything:

Код

*/3 * * * *
*3 * * * *

and now I have:

Код

6 0-23 * * *

GET THAT NOT automatically update.

What I have to do? Could you put a detailed manual configuration? Is there a problem with the component for joomla 3.0?

Thank you.


This post has been edited by Web Design Seo: Jan 5 2014, 08:20 AM

[Web Design Seo]

Try to import feed manual first. Keep in mind that items from one feed can be imported only once in joomla. Can be imported again only after 15 min. and only different items (joomla duplicate content protection is based on alias).

If you don't see items with these titles, check again in trash also

[r3d4sh]

I have a feed ready to import multiple news. These news if you look and when I imported the manual process (preview and import), but not with the cronjob. I no longer know what to do.

Greetings.

[Web Design Seo]

You must configure cron on two different places:
- in every rss feed in Joomla Scraper configuration (different settings for every feed)
- in cronjob configuration in your hosting control panel (set to run every 2, every 3 or every 5 minutes)

Create file with name mycron.php. Code for this php file:

Код

<?php
$a = file_get_contents('http://yoursite.com/administrator/components/com_aggregator/cron.aggregator.php');
?>

Upload file mycron.php in your public_html. Create cronjob in your cpanel with command:

Код

/usr/local/bin/php -q /relative path to public_html/mycron.php >> /dev/null

Set cron to run in your control panel (cpanel or other) every 5 or 3 minutes (recommended). In Unix Style view this should be:

Код

*/3 * * * *

How to test manual cron?
Set error reporting at maximum:



and open url:

Код

http://yoursite.com/administrator/components/com_aggregator/cron.aggregator.php

If this url is working, problem is not in our component. If cron not work with code posted in this post, contact your host support and ask "is this code correct":

Код

/usr/local/bin/php -q /relative path to public_html/mycron.php >> /dev/null

[4FootyFans]

Hello

Joomla 2.5.17

I had the same problem so set error reporting to maximum and ran manually.

http://mysite.com/administrator/components/com_aggregator/cron.aggregator.php

The result I received was:

"Notice: Undefined offset: 8 in ........./public_html/administrator/components/com_aggregator/helpers/cron.php on line 186"

for each feed.

This was followed by the actual 8 results.

If I run ......../mycron.php, a blank page is returned. If I run mycron.php via cpanel cron, a null result is returned.

The contents of mycron.php is:

<?php
$a = file_get_contents('http://mysite.com/administrator/components/com_aggregator/cron.aggregator.php');
?>

Could this be a firewall issue

I would appreciate your advice on this issue.

Best

This post has been edited by 4FootyFans: Jan 1 2014, 04:55 PM

[Web Design Seo]

No, this is not a firewall issue. You must confugure every feed to run it in different time (cron part in feed configuration). Than test every feed manual - one by one and without extras that load server (like scraper and download images function).

This topic will help you: https://3dwebdesign.org/forum/server-load-a...a-scraper-t1771 - read from post two.

[4FootyFans]

No, this is not a firewall issue. You must confugure every feed to run it in different time (cron part in feed configuration). Than test every feed manual - one by one and without extras that load server (like scraper and download images function).

This topic will help you: https://3dwebdesign.org/forum/server-load-a...a-scraper-t1771 - read from post two.

Hi

Yes, thank you. I realised that and have changed the times.

My other issue is that I cannot run the script unless I am already logged into the backend.

Do you have the command or script for including the admin username & password?

I have tried appendiing ?username="username" &password="password" but that does not work.

Thanks

[Web Design Seo]

Cron work without login, only by opening a url address. If you want to run it secure, just change file name from cron.aggregator.php to mysecretlongname.php.

[4FootyFans]

Cron work without login, only by opening a url address. If you want to run it secure, just change file name from cron.aggregator.php to mysecretlongname.php.

Ok. The problem is that I use Authentication before Admin login.

Is there a way to incorporate the authentication login/password?

Best

Eddie

[4FootyFans]

Ok. The problem is that I use Authentication before Admin login.

Is there a way to incorporate the authentication login/password?

Best

Eddie

I have resolved this issue. Thank You........