Search for a command to run...
I have been writing code since the mid 1990s. I started out my professional career building applications and games for mobile phones (J2ME, Palm, Symbian, etc) then some Android, iOS and then moved to building server applications using Spring framework, and frontend using JQuery. Now working on Spring Boot, Docker, Flutter etc.
No comments yet. Be the first to comment.
For those who work extensively with Asciidoc files, having a robust and feature-rich editing tool is essential. We have already see the power of Asciidoc and Asciidoctor in our previous articles as a writer's tool and a presentation tool. In this art...
The previous article our focus has been on delving into foundational elements of LangChain4j such as ChatLanguageModel, ChatMessage, ChatMemory, and others. Working with components at this level offers great flexibility and complete control, but it c...
In the preceding article, we were introduced to AI/ML concepts and explored the process of running a local Large Language Model (LLM) - Ollama. We further delved into interacting with it via Java using JBang and Langchain4j. Now, let's explore into ...
The realm of AI/ML, especially Generative AI, has garnered significant attention worldwide following the emergence of ChatGPT. Consequently, there has been a surge of interest in developing various models and tools within this domain. In this article...
In today's fast-paced tech world, giving effective presentations is crucial for conveying complex ideas and engaging audiences. While Markdown has emerged as a popular lightweight markup language for creating rich text documents, its use in creating ...
jsoup is a popular open-source Java library that enables developers to parse, manipulate, and extract data from HTML and XML documents. In this article, we will explore the basics of using jsoup, including parsing HTML documents, selecting and manipulating elements, and updating content in HTML. We'll provide code snippets along the way to help illustrate its capabilities.
jsoup simplifies working with real-world HTML and XML. It offers an easy-to-use API for URL fetching, data parsing, extraction, and manipulation using DOM API methods, CSS, and xpath selectors.
jsoup website mentions that it implements the WHATWG HTML5 specification, and parses HTML to the same DOM as modern browsers.
To begin using jsoup, you first need to add the library as a dependency in your project. If you are using Maven, include the following in your pom.xml file:
<dependency>
<groupId>org.jsoup</groupId>
<artifactId>jsoup</artifactId>
<version>x.xx.x</version>
</dependency>
where x.xx.x is the relevant version, as of this writing it is 1.15.3
or if you are using Gradle, include the following in your build.gradle file:
implementation 'org.jsoup:jsoup:x.xx.x'
To parse an HTML document using jsoup, you can use the jsoup.connect() method followed by the URL of the HTML file or webpage you want to work with. Here's a simple example:
import org.jsoup.jsoup;
import org.jsoup.nodes.Document;
public class jsoupExample {
public static void main(String[] args) throws Exception {
Document document = jsoup.connect("https://www.example.com").get();
// Continue working with the parsed document
}
}
jsoup provides several methods to select and manipulate elements in an HTML or XML document. For example, you can use the select() method to select elements based
on their tags or attributes, like this:
import org.jsoup.jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;
public class jsoupExample {
public static void main(String[] args) throws Exception {
Document document = jsoup.connect("https://www.example.com").get();
// Select all 'h1' tags in the document
Elements h1Elements = document.select("h1");
// Update the content of the first 'h1' tag
for (Element h1 : h1Elements) {
h1.text(h1.text().replaceAll("old", "new"));
}
}
}
In addition to selecting and manipulating elements, you can also update the content of individual elements or the entire document using various methods provided by jsoup. For example:
import org.jsoup.jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
public class jsoupExample {
public static void main(String[] args) throws Exception {
Document document = jsoup.connect("https://www.example.com").get();
// Update the content of a specific element
Element header = document.selectFirst("h1");
if (header != null) {
header.text("New Header");
}
// Update the entire document's content
String newContent = "This is the updated content.";
document.body().html(newContent);
}
}
jsoup is a powerful Java library for working with HTML and XML documents, enabling developers to parse, extract data, and manipulate elements efficiently. By using jsoup's simple yet effective APIs, you can save time and effort while producing cleaner, more maintainable code. It can effectively be used in content scraping (of course, without violating any policies or legal requirements) or editing and manipulating the documents in the document store or archive. Happy Coding!