Welcome Guest ( Log In | Register )

 Forum Rules Joomla Scraper support
5 Pages V  « < 2 3 4 5 >  
Reply to this topicStart new topic
> Joomla Scraper, Grabber For Joomla, Joomla Scraper Can Grab Any Content From Any Website
Web Design Seo
post Mar 31 2014, 01:20 PM
Post #61


Web Design Seo
****

Group: Root Admin
Posts: 4,161
Joined: 29-April 09
From: Sofia
Member No.: 1



I recommend you to put in Allowed HTML tags default string:
Код
<img><strong><p><br/><br>


If Allowed HTML tags field is clear, scraper will clear ALL html tags - you will import in site only clear text.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
ataman79
post Apr 1 2014, 02:28 PM
Post #62


Newbie
*

Group: Members
Posts: 32
Joined: 26-November 10
Member No.: 399



QUOTE (Web Design Seo @ Mar 31 2014, 02:20 PM) *
I recommend you to put in Allowed HTML tags default string:
CODE
<img><strong><p><br/><br>


If Allowed HTML tags field is clear, scraper will clear ALL html tags - you will import in site only clear text.



OK I left it as it's by default, but even that I grab again the whole new, not a certain number of characters

So where is my mistake, I filled exactly the same options in Publish tab as on you picture and in Scraper tab I set :
Starting string length: 30
Starting string : <div id="news_text_inner">
Ending string: <div class="news_ad_footer">

Thank you in advance
Go to the top of the page
 
+Quote Post
ataman79
post Apr 9 2014, 09:47 AM
Post #63


Newbie
*

Group: Members
Posts: 32
Joined: 26-November 10
Member No.: 399



Can someone help me ?
Why I can not get only a certain number of characters from the whole new ?
Go to the top of the page
 
+Quote Post
Web Design Seo
post Apr 9 2014, 02:57 PM
Post #64


Web Design Seo
****

Group: Root Admin
Posts: 4,161
Joined: 29-April 09
From: Sofia
Member No.: 1



Check this first: As is written in our guide, strings (start tag and end tag) must be unique.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
ataman79
post Apr 9 2014, 03:18 PM
Post #65


Newbie
*

Group: Members
Posts: 32
Joined: 26-November 10
Member No.: 399



QUOTE (Web Design Seo @ Apr 9 2014, 03:57 PM) *
Check this first: As is written in our guide, strings (start tag and end tag) must be unique.


The strings which I'm using are unique. And they are working, it grabs the whole new. But as I asked earlier, I want to grab only a certain number of characters from the whole text.
You send me a screen shot how to set the settings, and based on it I set them, but even that I am still getting the whole text, not only the characters I set in Introtext length [chars] - 100

Other my settings in Publish tab are:
Split introtext - "After Before Item"
Introtext length [chars] - 100
Strip content HTML tags - Yes
Strip title HTML tags - Yes
Strip special chars in title - No
Allowed HTML tags - <img><strong><p><br/><br>

And even that I'm getting the whole text, so what else should I do ?
Go to the top of the page
 
+Quote Post
Web Design Seo
post Apr 9 2014, 06:22 PM
Post #66


Web Design Seo
****

Group: Root Admin
Posts: 4,161
Joined: 29-April 09
From: Sofia
Member No.: 1



Цитат(Web Design Seo @ Mar 20 2014, 01:49 PM) *
Is possible only with combination of both functions: Strip HTML and Introtext Lenght. But content will be without HTML - as clear text.



As i say previous time if you use Introtext Lenght, content probably will be brokenл Our extension is not well working with this combination and we recommend to use this function ONLY in combination with strip all html tags (will be imported clear text).

Why Introtext Lenght not work well with html tags?
Every php prgrammer with some programming experience in grabbers development will say you: is hard to develop scraper that recognize all html tags and automatically close these tags in content. There can be many paragraphs, divs and many more nested html tags.

Will be this function inside next 1-2 Scraper component updates?
This function is not planned for next 2 upodates.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
ataman79
post Apr 11 2014, 03:00 PM
Post #67


Newbie
*

Group: Members
Posts: 32
Joined: 26-November 10
Member No.: 399



I understood what you mean and I done exactly what you said. Please have a look at the pictures with the settings.
But even that I can not get certain number of the article sad.gif






Any idea ?

This post has been edited by ataman79: Apr 11 2014, 03:20 PM
Go to the top of the page
 
+Quote Post
ataman79
post May 10 2014, 08:53 AM
Post #68


Newbie
*

Group: Members
Posts: 32
Joined: 26-November 10
Member No.: 399



Hi ,
I still have no answer to my question

can you please check my posts above ?

Thanks
Go to the top of the page
 
+Quote Post
Web Design Seo
post May 10 2014, 09:30 AM
Post #69


Web Design Seo
****

Group: Root Admin
Posts: 4,161
Joined: 29-April 09
From: Sofia
Member No.: 1



Starting string lenght function in scraper work only if start tag and end tag are not configured. We don't recommend you to use "Starting string lenght" function in scraper at all.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
ataman79
post May 10 2014, 09:55 AM
Post #70


Newbie
*

Group: Members
Posts: 32
Joined: 26-November 10
Member No.: 399



QUOTE (Web Design Seo @ May 10 2014, 10:30 AM) *
Starting string lenght function in scraper work only if start tag and end tag are not configured. We don't recommend you to use "Starting string lenght" function in scraper at all - clear this field in options.


I am clearing it, but it always put me default value 30 ?????
the only thing I can set is 0 , is this ok ?

And is this the problem, for which I can not get only certain number of characters from the full article ?

This post has been edited by ataman79: May 10 2014, 10:00 AM
Go to the top of the page
 
+Quote Post
Web Design Seo
post May 10 2014, 11:23 AM
Post #71


Web Design Seo
****

Group: Root Admin
Posts: 4,161
Joined: 29-April 09
From: Sofia
Member No.: 1



Save not working? Will be checked in monday from programmer.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
ataman79
post May 10 2014, 11:36 AM
Post #72


Newbie
*

Group: Members
Posts: 32
Joined: 26-November 10
Member No.: 399



QUOTE (Web Design Seo @ May 10 2014, 12:23 PM) *
Save not working? Will be checked in monday from programmer.



I mean that when I clear the field "Starting string length" - without any value in the field, and after that when I press Save & Close, it puts automatically the value 30. I mean it always wants to have some value - that's why I wrote that I can put value 0

OK I will wait for your answer.
Go to the top of the page
 
+Quote Post
Web Design Seo
post May 10 2014, 11:44 AM
Post #73


Web Design Seo
****

Group: Root Admin
Posts: 4,161
Joined: 29-April 09
From: Sofia
Member No.: 1



30 is default value.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
ataman79
post May 10 2014, 11:51 AM
Post #74


Newbie
*

Group: Members
Posts: 32
Joined: 26-November 10
Member No.: 399



QUOTE (Web Design Seo @ May 10 2014, 10:30 AM) *
Starting string lenght function in scraper work only if start tag and end tag are not configured. We don't recommend you to use "Starting string lenght" function in scraper at all.



Yes , correct it's the default value , that's why I wrote that it always puts this value. And you wrote me that I must clear the Starting string length

-----------------------

Именно дефоулт стойността е 30 и винаги ми я слага, а ти ми писа, че полето трабвало да бъде изчистено ...

Това ли може да е проблема, заради който не мога да взема определена дължина от пълния текст ?

---------------

Go to the top of the page
 
+Quote Post
Web Design Seo
post May 20 2014, 09:44 AM
Post #75


Web Design Seo
****

Group: Root Admin
Posts: 4,161
Joined: 29-April 09
From: Sofia
Member No.: 1



New version of Joomla Scraper for Joomla 3.x is released - v.1.9.5 with a lot of improvements (only Joomla 3 version is updated).


Changes in Joomla Scraper v.1.9.5:

  • Fixed bug when site is in sub directory "Class JFile Not Found"
  • New options for images in articles (com_content only): Setting images as Intro Image and/or Full article image in content articles.


1. Set Content Images (Yes/No) - Script will try to find most appropriate image from content and will set this image as "Intro Image" and/or "Full article image". If this fails than will be used default image bellow. If default image is empty than no image will be configured. Attention: This option requires enabled images download!
2. Default Image (File choose) - Set selected image as "Intro Image" and/or "Full article image" in cases when no image if found from scraped content.
3. Minimum Image Side (integer) - This will limit automatic choice to images, which smaller side is bigger or equal to selected value. Images with smaller side than selected will be considered inappropriate.
4. Set Intro Image(Yes/No) - Automatically selected image will be set as "Intro Image" for newly created article.
5. Set Full Article Image(Yes/No) - Automatically selected image will be set as "Full article image" for newly created article.

Screenshot from new functions:




How it works?
1. All images that were found in feed are downloaded locally (download images function must be switched on).
2. Image list is filtered only to images with bigger sides than setting "Minimum Image Side".
3. All images are sorted by proportions. For example image with sides 400x300 pixels have proportions of 4/3 or 1.333(3).
4. All images are sorted by closest proportions to 1.333.
5. If there are multiple images with the same proportion and this proportion is closest possible to 1.333, than biggest (by pixels, not file size) image is selected.
6. This image is set for "Intro Image" and/or inside "Full article image" - you have settings for both.
7. As alt text is set article alias (commonly article title) - this is very good for SEO.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
Web Design Seo
post May 21 2014, 10:33 AM
Post #76


Web Design Seo
****

Group: Root Admin
Posts: 4,161
Joined: 29-April 09
From: Sofia
Member No.: 1



Aggregator scrapper for joomla 3 is updated again with some bug fixes. Version number is now v.1.9.5.1

Bugs fixed:
Цитат
1. Fixed problem with cyrillic titles containing quotation marks.
2. Fixed problem with cyrillic url alias transliteration in K2.



--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
Web Design Seo
post May 27 2014, 11:01 AM
Post #77


Web Design Seo
****

Group: Root Admin
Posts: 4,161
Joined: 29-April 09
From: Sofia
Member No.: 1



New version 1.9.6 of aggregator_scarper for joomla 3 is available (is updated only joomla 3 version).

What's new in v.1.9.6?
Four new functions inside this Scraper version.


In "Publish" section:



1. Force protocol (Leave Intact, HTTP, HTTPS, Not Specified)
Set protocol in src and href attributes. Change protocol to secure(https) or not(http). When your site is running under https some resources which are using http can be blocked from browsers. Leave Intact will not change anything. HTTP or HTTPS will force protocol to respective one. Not Specified will remove protocol information. For example http://site.com will become //site.com. In this case protocol will be automatically determined by client browser. This is best option if content is provided in both protocols http and https. This is also valid for youtube videos.

2. Skip when forcing protocol
Protocol(http or https) will be forced in "scr" and "href" attributes for all tags except listed. Default value is "a". This will preserve changing links.


In "Image Download" Section

1. Skip smaller than(px)
Images with smaller size, than selected, will be skipped and removed from content. It is measured smaller side of the image. For example if you have image with dimensions 240x180 than 180 will be used for comparison.



2. Maximum Images
Maximum number of images, which to be left in content. All images after selected number will be removed from file system and content.


With these FOUR new options:
  • You can use our aggregator in https-only sites with ssl certificate.
  • You can import "clear text only" full articles as clear text, but with beautiful look. With options scraper, "strip html tags" and "image download" switched on, but selected to import only one big picture, Articles will be imported with full text, without html tags and links, but all will be beautiful looking, with picture.
  • Guide: How to import beautiful clear text only full articles with only main picture.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
pavelKukov
post Sep 15 2014, 01:16 PM
Post #78


Php programmer
****

Group: Administrators
Posts: 285
Joined: 26-November 12
From: Bulgaria
Member No.: 1,452



New versions of Aggregator Scrapper are available for both joomla 2.5 and 3.x
It is fixed bug affecting integration with kunena.
Number of new version is 1.9.7


--------------------
Php programmer in 3D Web Design
Go to the top of the page
 
+Quote Post
Web Design Seo
post Oct 6 2014, 09:52 AM
Post #79


Web Design Seo
****

Group: Root Admin
Posts: 4,161
Joined: 29-April 09
From: Sofia
Member No.: 1



Joomla Scraper v.1.9.8 for Joomla3 is released. This release is bug fix, is updated only Joomla 3 version!

Цитат
Fixed: Strip content in multiple places. Separate markers by new line not working.


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post
Web Design Seo
post Jan 12 2016, 03:12 PM
Post #80


Web Design Seo
****

Group: Root Admin
Posts: 4,161
Joined: 29-April 09
From: Sofia
Member No.: 1



12.01.2016: Released Joomla Scraper new version - v.1.9.9 for Joomla 3. Changes:

1. Added new option to limit length of imported content. Works with or without Scraper.

Attached File  limit_imported_content_lenght.png ( 27.65K ) Number of downloads: 4


2. New function for images seo - to add relevant alt of imported pictures. There is no new option in feed configuration - alt tag is automatically added to images imported in content, to Intro image and to Full article image (see screen).

Attached File  images.png ( 18.05K ) Number of downloads: 2


--------------------
Правила на форума | Forum Rules | How to receive support. 3D Web Design: Уеб дизайн, Seo оптимизация, Web Site Extensions, Oscommerce Addons, Wordpress plugins and Joomla Extensions. Изработка на уеб сайтове и оптимизация на сайт за търсачки и Seo услуги.
Go to the top of the page
 
+Quote Post

5 Pages V  « < 2 3 4 5 >
Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

Collapse

> Similar Topics

  Topic Replies Topic Starter Views Last Action
No new Pinned: Topic has attachmentsJoomla Vulnerable Extensions List
list with new Joomla exploits
20 Web Design Seo 24,953 26th September 2018 - 05:07 AM
Last post by: Web Design Seo
No new Pinned: Joomla Pagination Seo Plugin
SEO plugin for Joomla Pagination that work in all Joomla
61 Web Design Seo 64,750 13th March 2018 - 10:05 AM
Last post by: mxcpz
No New Posts Pinned: Joomla Scraper Going Open Source
No licenses, use scraper on unlimited number of web sites
0 Web Design Seo 6,221 8th March 2017 - 07:40 AM
Last post by: Web Design Seo
No New Posts Pinned: Joomla Ден 2016
Joomla Day 2016
1 Web Design Seo 20,129 31st October 2016 - 10:11 AM
Last post by: Web Design Seo
No New Posts Joomla Post By Email To K2 Extra Fields
1 uglykidjoe 13,677 11th February 2016 - 07:45 AM
Last post by: Web Design Seo
No new Pinned: Joomla Scraper Integration With K2
better integration of Joomla Scraper and K2
8 Web Design Seo 25,027 2nd January 2016 - 09:07 AM
Last post by: b_goranov
No New Posts Joomla Scraper Not Working
2 Jan Hädicke 8,208 11th November 2015 - 02:05 PM
Last post by: Web Design Seo
No New Posts Joomla Scrapper Subscription And Licensing Model
3 omoj 8,626 15th October 2014 - 06:06 AM
Last post by: Web Design Seo
No New Posts Joomla Developer For Hire
Hire Joomla! developers
0 Web Design Seo 8,400 25th July 2014 - 08:00 AM
Last post by: Web Design Seo
No New Posts Pinned: Joomla Web Development From Joomla Developer
web development of joomla extensions from experienced developers
0 Web Design Seo 8,368 14th May 2014 - 01:07 PM
Last post by: Web Design Seo


 



RSS Lo-Fi Version Time is now: 19th October 2019 - 04:18 AM
Clicky Web Analytics