CVE-2024-0243

With the following crawler configuration:<br /> <br /> ```python<br /> from bs4 import BeautifulSoup as Soup<br /> <br /> url = "https://example.com"<br /> loader = RecursiveUrlLoader(<br /> url=url, max_depth=2, extractor=lambda x: Soup(x, "html.parser").text<br /> )<br /> docs = loader.load()<br /> ```<br /> <br /> An attacker in control of the contents of `https://example.com` could place a malicious HTML file in there with links like "https://example.completely.different/my_file.html" and the crawler would proceed to download that file as well even though `prevent_outside=True`.<br /> <br /> https://github.com/langchain-ai/langchain/blob/bf0b3cc0b5ade1fb95a5b1b6fa260e99064c2e22/libs/community/langchain_community/document_loaders/recursive_url_loader.py#L51-L51<br /> <br /> Resolved in https://github.com/langchain-ai/langchain/pull/15559