Welcome Guest ( Log In | Register )

 Forum Rules Joomla Scraper support
5 Pages V  < 1 2 3 4 > »   
Reply to this topicStart new topic
> Joomla Scraper, Grabber For Joomla, Joomla Scraper Can Grab Any Content From Any Website
Ivan Stamenov
post Sep 10 2012, 10:21 AM
Post #21


Advanced User
****

Group: Advanced Member
Posts: 218
Joined: 15-April 11
Member No.: 761



A new custom RSS parser is added to the Joomla 2.5 version of the component. This RSS parser is our work and is much faster and less memory consuming than SimplePie and is suitable for parsing large feeds.




With our custom Feed parser you can insert only selected fields from rss feed in content, so, you can use non-standart feeds like xml files with some products and others that are not parsed by default from simplepie.


There are some settings that need to be set for every feed, though. The parser needs to be told where (in which XML tag) to find the relevant content. The following notation must be used:

tag[.required_property_name1:required_property_value1]...[.wanted_property_name]

E.g.:
Код
<link>http://the.link.we.want/</link>
=> set the link tag setting to: link, "get the content of the link tag"

Код
<link rel='alternate'>http://the.link.we.want/</link>
=> set the link tag setting to: link.rel:alternate, "get the content of the link tag with rel property = alternate"

Код
<link rel='alternate' alt='permalink' href='http://the.link.we.want/' />
=> set the link tag setting to: link.rel:alternate.alt:permalink.href, "get the content of the href property of the link tag with rel property = alternate and alt property = permalink"


New version is already uploaded in our file directory.
Go to the top of the page
 
+Quote Post
Ivan Stamenov
post Sep 19 2012, 06:47 AM
Post #22


Advanced User
****

Group: Advanced Member
Posts: 218
Joined: 15-April 11
Member No.: 761



Version 1.7.6 of the Scraper is available. Now JomSocial and Kunena 2.0 forums are supported.



When importing into JomSocial, the following settings are available:
- Profile owner;
- Post where: "As status update" or "On wall";
- Allow comments.

When importing into Kunena 2.0, the following settings are available:
- Forum
- Author ID: the user ID of the posts' author
- Thread ID (optionsl): If set, all the articles will be imported as new posts in this thread. If 0, each article will be posted as separate thread.
Go to the top of the page
 
+Quote Post
Web Design Seo
post Sep 19 2012, 07:10 AM
Post #23


Web Design Seo
****

Group: Root Admin
Posts: 4,156
Joined: 29-April 09
From: Sofia
Member No.: 1



ACL and import in Jomsocial and Kunena are only for Joomla 2.5 version. Import of Kunena is developed to work only with Kunena 2.0 and over. May be will work with older Kunena versions also, but ia not tested and we don't guarantee this.

New version of Joomla Scraper is already avalable for purchase.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
Web Design Seo
post Nov 7 2012, 11:02 AM
Post #24


Web Design Seo
****

Group: Root Admin
Posts: 4,156
Joined: 29-April 09
From: Sofia
Member No.: 1



Today is released new version for Joomla 1.5 - Joomla Scraper 1.6.4. Only Joomla 1.5 version is updated!

New version add automated SEO functions on next level!

Цитат
New function is added with integration with component Advanced Tags (also updated today). Until now, component add as tags only one word keywords extracted from title.

Now, when automatic articles are added, tag component count phrases in title and in body of article and add configured from you number of top key phrases as tags. In this way you can have more in long tail keywords and key phrases.


In this way will be updated and version for Joomla 2.5. This update pending in next 3-4 days.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
Ivan Stamenov
post Nov 8 2012, 01:37 PM
Post #25


Advanced User
****

Group: Advanced Member
Posts: 218
Joined: 15-April 11
Member No.: 761



New version 1.7.7 is now here. v.1.7.7 of Joomla Scraper is bug fix release. The fixed bugs are as follows:

1. The RSS parser didn't convert all the result fields in UTF-8;
2. The article tags were not correctly added using the Advanced Tags component.

Go to the top of the page
 
+Quote Post
SilverOne
post Dec 5 2012, 03:43 PM
Post #26


Newbie
*

Group: Members
Posts: 3
Joined: 4-December 12
Member No.: 1,467



QUOTE (Web Design Seo @ May 18 2011, 04:09 PM) *
Pictures from all functions are below


Custom Rss parser:



In the picture above, according to example give is it word 'link' we have to fill in the field or the true link (=http://the.link.we.want/)?

This post has been edited by SilverOne: Dec 5 2012, 03:45 PM
Go to the top of the page
 
+Quote Post
Web Design Seo
post Dec 5 2012, 04:05 PM
Post #27


Web Design Seo
****

Group: Root Admin
Posts: 4,156
Joined: 29-April 09
From: Sofia
Member No.: 1



You must fill in there the field.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
SilverOne
post Dec 5 2012, 09:48 PM
Post #28


Newbie
*

Group: Members
Posts: 3
Joined: 4-December 12
Member No.: 1,467



QUOTE (Web Design Seo @ Dec 5 2012, 04:05 PM) *
the field


You have not answered to my question, also I repeat it:

In the picture above, according to example given is it the word 'link' we have to fill in the field or the true link we have to fill in the field (=http://the.link.we.want/)?
Go to the top of the page
 
+Quote Post
Web Design Seo
post Dec 6 2012, 07:05 AM
Post #29


Web Design Seo
****

Group: Root Admin
Posts: 4,156
Joined: 29-April 09
From: Sofia
Member No.: 1



You must fill in there the field.

You must open rss feed, than you must open xml code of this rss feed (press ctrl+u in browser) and must say parser: Hey, content from field "link" in feed code must go to field in joomla scraper parser options "link".

Is now ok smile.gif


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
Web Design Seo
post Dec 19 2012, 09:52 AM
Post #30


Web Design Seo
****

Group: Root Admin
Posts: 4,156
Joined: 29-April 09
From: Sofia
Member No.: 1



We find bug and Scraper version will be updated in next hours: If "download images" function is switched on, Joomla Scraper don't import images in K2 tab "image".

Today is released fix for this case and scraper are updated to versions:
- 1.7.8 for Joomla 2.5
- 1.6.5 for Joomla 1.5


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
Web Design Seo
post Dec 21 2012, 12:02 PM
Post #31


Web Design Seo
****

Group: Root Admin
Posts: 4,156
Joined: 29-April 09
From: Sofia
Member No.: 1



v.1.7.9 for Joomla 2.5 and 1.6.6 for Joomla 1.5 are released today. This version is only with bug fixes - for some cases of non-import pictures in K2.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
Web Design Seo
post Jan 7 2013, 10:19 AM
Post #32


Web Design Seo
****

Group: Root Admin
Posts: 4,156
Joined: 29-April 09
From: Sofia
Member No.: 1



Today Joomla Scraper is updated with this bug fix in aggregator cron.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
Ivan Stamenov
post Jan 8 2013, 10:25 AM
Post #33


Advanced User
****

Group: Advanced Member
Posts: 218
Joined: 15-April 11
Member No.: 761



Joomla Scraper Version 1.8.0 for Joomla 2.5 is here. It allows images without extension to be imported as well.
It does not implement the latest SimplePie parser yet.
Go to the top of the page
 
+Quote Post
Ivan Stamenov
post Jan 9 2013, 01:16 PM
Post #34


Advanced User
****

Group: Advanced Member
Posts: 218
Joined: 15-April 11
Member No.: 761



Joomla Scraper Version 1.8.1 for Joomla 2.5 is now available.

It allows the latest SimplePie (ver. 1.3.1 - PHP 5.2) to be used in addition to the obsolete 1.1.2 (PHP 4).
One may choose which SimplePie version to use on a per RSS feed basis.
Important note: As the classes in both SimplePie versions have the same names, though, when using the "Import All" button, the first loaded SimplePie version will serve all the remaining feeds as well (regardless of their SimplePie version), because PHP does not allow a class (with the same name) to be re-declared.

Finally xAjax is gone as well.

If we keep the current pace, Scraper ver. 12574545.0.1 will be coming soon... smile.gif
Go to the top of the page
 
+Quote Post
Ivan Stamenov
post Jan 9 2013, 01:24 PM
Post #35


Advanced User
****

Group: Advanced Member
Posts: 218
Joined: 15-April 11
Member No.: 761



For those of you, willing to update their SimplePie version to 1.3.1, please follow these steps:

1. Download the latest SimplePie: Attached File  simplepie.131.inc.zip ( 63.48K ) Number of downloads: 11
;
2. Extract the archive and rename the contained file to simplepie.inc;
3. Upload it to /administrator/components/com_aggregator/inc/simplepie/ and overwrite the existing file.

If you are using PHP 5.2+, you are strongly encouraged to do so as this will get you rid of all these SimplePie "Deprecated: ..." warnings.


Can be differences in performance between parser versions!
Scraper version have 3 different parsers - 2 simplepie (old and new) and one custom parser. Different simplepie parsers have different performance also.

By default parser in "Joomla Scraper" is latest simplepie. We don't have checked and measured performance of old and new simplepie - may be some feeds will work better with old version of simplepie.

If you get "deprecated" or other error, use new version of simplepie parser.
Go to the top of the page
 
+Quote Post
Web Design Seo
post Jan 15 2013, 12:40 PM
Post #36


Web Design Seo
****

Group: Root Admin
Posts: 4,156
Joined: 29-April 09
From: Sofia
Member No.: 1



Today is released bug fix for pagination in list with all feeds in component. Are changed many files, we can't post here this fix.

To receive update, please, send us email from email used in your order. These three users that have buy extension yesterday and today are already received update.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
pavelKukov
post Jan 29 2013, 02:55 PM
Post #37


Php programmer
****

Group: Administrators
Posts: 285
Joined: 26-November 12
From: Bulgaria
Member No.: 1,452



Today, 2013-01-29 is released new version 1.8.4 of Aggregator-Scraper for Joomla. New version support some new great features.

1. Now is possible to preview imported items. Screenshot:



If you select one or more feeds and click on button "preview", you will see the result content that will be imported. This function is to test and fine tuning of rss feeds configuration.

2. You can limit number of imported articles. Screenshot:



If you write in field "feed limit" some number, for example 5, only first 5 items from this feed will be imported in joomla database.


--------------------
Php programmer in 3D Web Design
Go to the top of the page
 
+Quote Post
Web Design Seo
post Feb 1 2013, 07:00 AM
Post #38


Web Design Seo
****

Group: Root Admin
Posts: 4,156
Joined: 29-April 09
From: Sofia
Member No.: 1



Today is released version 1.8.5. Added one new function: keywords filter.



You have now filter to configure keywords - one or more. Item from feed will be imported only if some of keywords is find in title or in item body. This option allow you to filter results by keyword and to build better thematic websites. You can configure one feed many times with different keyword filters and to import results in suitable category.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
Web Design Seo
post Feb 7 2013, 01:49 PM
Post #39


Web Design Seo
****

Group: Root Admin
Posts: 4,156
Joined: 29-April 09
From: Sofia
Member No.: 1



Joomla Scraper v.1.8.6 for Joomla 3.0 is released.

Screenshots from Joomla3 version:






Цитат
Version for Joomla 3.0 support import only in content and K2!


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
pavelKukov
post Feb 25 2013, 10:55 AM
Post #40


Php programmer
****

Group: Administrators
Posts: 285
Joined: 26-November 12
From: Bulgaria
Member No.: 1,452



Now Joomla Scraper for Joomla 1.5 and 2.5 have improved content shuffling algorithm and new options for better control and automated manipulation. The new algorithm is more precise and produced texts are more readable. New options and settings are:

Shuffle sentences positions - Shuffle the positions of the sentences in the article.
Shuffle sentences - Shuffle the compound sentences using the given characters as a delimiter
Delimiters for sentences - Delimiters used for splitting text into sentences
Delimiters for sentence parts - Delimiters used for splitting sentence into parts
Punctuation characters - List of characters considered as punctuation and disallowed be at start or end of sentence
Minimum sentence length - Sentences shorter than n characters will be removed. Use this option for cleaning small errors like sentences only from names. Example Mr. Paul Kalkbrenner will be split to two sentences because of the dot after Mr.
Fragment shuffling - Fragment shuffling if allowed (if sentence or part of it contain more than n words and do not contain delimiters, it will be split in to phrases which will be shuffled randomly)
Shuffling long phrases - Long phrases prevention if fragment shuffling is allowed. If given text fragment is built up with less than required number words will not be affected from long phrase detection algorithm (with other words - if you want to shuffle small sentences you must set number here. )
Protected HTML tags - Comma separated list of HTML tags which to be protected when removing HTML. This gives you opportunity to keep some formatting.

Latest updated versions are: v.1.8.8 for Joomla 2.5 and v.1.6.7 for joomla 1.5.

This post has been edited by Web Design Seo: Feb 25 2013, 11:12 AM


--------------------
Php programmer in 3D Web Design
Go to the top of the page
 
+Quote Post

5 Pages V  < 1 2 3 4 > » 
Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

Collapse

> Similar Topics

  Topic Replies Topic Starter Views Last Action
No new Pinned: Topic has attachmentsJoomla Vulnerable Extensions List
list with new Joomla exploits
20 Web Design Seo 23,910 26th September 2018 - 05:07 AM
Last post by: Web Design Seo
No new Pinned: Joomla Pagination Seo Plugin
SEO plugin for Joomla Pagination that work in all Joomla
61 Web Design Seo 63,374 13th March 2018 - 10:05 AM
Last post by: mxcpz
No New Posts Pinned: Joomla Scraper Going Open Source
No licenses, use scraper on unlimited number of web sites
0 Web Design Seo 6,003 8th March 2017 - 07:40 AM
Last post by: Web Design Seo
No New Posts Pinned: Joomla Ден 2016
Joomla Day 2016
1 Web Design Seo 19,193 31st October 2016 - 10:11 AM
Last post by: Web Design Seo
No New Posts Joomla Post By Email To K2 Extra Fields
1 uglykidjoe 13,463 11th February 2016 - 07:45 AM
Last post by: Web Design Seo
No new Pinned: Joomla Scraper Integration With K2
better integration of Joomla Scraper and K2
8 Web Design Seo 24,792 2nd January 2016 - 09:07 AM
Last post by: b_goranov
No New Posts Joomla Scraper Not Working
2 Jan Hädicke 8,018 11th November 2015 - 02:05 PM
Last post by: Web Design Seo
No New Posts Joomla Scrapper Subscription And Licensing Model
3 omoj 8,498 15th October 2014 - 06:06 AM
Last post by: Web Design Seo
No New Posts Joomla Developer For Hire
Hire Joomla! developers
0 Web Design Seo 8,309 25th July 2014 - 08:00 AM
Last post by: Web Design Seo
No New Posts Pinned: Joomla Web Development From Joomla Developer
web development of joomla extensions from experienced developers
0 Web Design Seo 8,281 14th May 2014 - 01:07 PM
Last post by: Web Design Seo


 



RSS Lo-Fi Version Time is now: 17th September 2019 - 04:25 AM
Clicky Web Analytics