{"id":3114,"date":"2023-11-08T19:19:01","date_gmt":"2023-11-08T19:19:01","guid":{"rendered":"https:\/\/promptmuse.com\/?page_id=3114"},"modified":"2023-11-08T19:24:20","modified_gmt":"2023-11-08T19:24:20","slug":"gpt-turbo-jsonl-converter-for-a-i-fine-tuning","status":"publish","type":"page","link":"https:\/\/promptmuse.com\/gpt-turbo-jsonl-converter-for-a-i-fine-tuning\/","title":{"rendered":"GPT3 OLD &#8211; JSONL Converter for A.I Fine-Tuning"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-page\" data-elementor-id=\"3114\" class=\"elementor elementor-3114\" data-elementor-post-type=\"page\">\n\t\t\t\t\t\t<section class=\"has-el-gap el-gap-default elementor-section elementor-top-section elementor-element elementor-element-e4fbc30 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"e4fbc30\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-no\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-cca07ca\" data-id=\"cca07ca\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-62d26fe elementor-widget elementor-widget-html\" data-id=\"62d26fe\" data-element_type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<script>\n    function initialize() {\n    document.getElementById('importFile').addEventListener('change', handleFileSelect, false);\n    document.getElementById('addBtn').addEventListener('click', addEntry);\n    document.getElementById('updateBtn').addEventListener('click', updateEntry);\n    document.getElementById('deleteBtn').addEventListener('click', deleteLastLine);\n    document.getElementById('downloadBtn').addEventListener('click', downloadJson);\n    document.getElementById('exportBtn').addEventListener('click', exportToCsv);\n    document.getElementById('search').addEventListener('input', searchJson);\n    document.getElementById('formatUploadBtn').addEventListener('click', formatForUpload);\n\n    let data = [];\n    let selectedIndex = -1;\n\n    function formatForUpload() {\n        data = data.map(entry => {\n            const hasPromptSuffix = entry.prompt.endsWith(\" ###\");\n            const hasCompletionPrefix = entry.completion.startsWith(\" \");\n            const hasCompletionSuffix = entry.completion.endsWith(\" END\");\n\n            return {\n                prompt: hasPromptSuffix ? entry.prompt : entry.prompt + \" ###\",\n                completion: (hasCompletionPrefix ? \"\" : \" \") + entry.completion + (hasCompletionSuffix ? \"\" : \" END\")\n            };\n        });\n        updateJsonlPreview();\n    }\n\n    function handleFileSelect(evt) {\n        const file = evt.target.files[0];\n        const reader = new FileReader();\n\n        reader.onload = (event) => {\n            const fileContent = event.target.result;\n            const lines = fileContent.split('\\n');\n            const headers = lines[0].split(',').map(header => header.trim().toLowerCase());\n\n            const promptIndex = headers.indexOf('prompt');\n            const completionIndex = headers.indexOf('completion');\n\n            if (promptIndex === -1 || completionIndex === -1) {\n                alert('Invalid CSV file. Please make sure it contains the \"PROMPT\" and \"COMPLETION\" columns.');\n                return;\n            }\n\n            for (let i = 1; i < lines.length; i++) {\n                const line = lines[i];\n                if (line) {\n                    const values = line.split(',');\n                    const entry = {\n                        prompt: values[promptIndex].replace(\/['\"]+\/g, ''),\n                        completion: values[completionIndex].replace(\/['\"]+\/g, '')\n                    };\n                    data.push(entry);\n                }\n            }\n            updateJsonlPreview();\n        };\n        reader.readAsText(file);\n    }\n\n    function addEntry() {\n        const prompt = document.getElementById('prompt').value;\n        const completion = document.getElementById('completion').value;\n\n        if (prompt && completion) {\n            const newEntry = { prompt, completion };\n\n            if (isDuplicateEntry(newEntry)) {\n                alert('This entry is a duplicate and cannot be added.');\n            } else {\n                data.push(newEntry);\n                updateJsonlPreview();\n            }\n        }\n    }\n\n    function isDuplicateEntry(newEntry) {\n        return data.some(entry => entry.prompt === newEntry.prompt && entry.completion === newEntry.completion);\n    }\n\n    function updateJsonlPreview() {\n        const jsonlPreview = document.getElementById('jsonlPreview');\n        jsonlPreview.value = data.map(entry => JSON.stringify(entry)).join('\\n');\n        jsonlPreview.addEventListener('click', selectLine);\n    }\n\n    function selectLine() {\n        const jsonlPreview = document.getElementById('jsonlPreview');\n        const cursorPosition = jsonlPreview.selectionStart;\n        let start = cursorPosition;\n        let end = cursorPosition;\n\n        while (start > 0 && jsonlPreview.value[start - 1] !== '\\n') {\n            start--;\n        }\n\n        while (end < jsonlPreview.value.length && jsonlPreview.value[end] !== '\\n') {\n            end++;\n        }\n\n        const selectedLine = jsonlPreview.value.substring(start, end).trim();\n        if (selectedLine) {\n            const entry = JSON.parse(selectedLine);\n            document.getElementById('prompt').value = entry.prompt;\n            document.getElementById('completion').value = entry.completion;\n            selectedIndex = data.findIndex(e => e.prompt === entry.prompt && e.completion === entry.completion);\n        }\n    }\n\n    function updateEntry() {\n        if (selectedIndex >= 0) {\n            const prompt = document.getElementById('prompt').value;\n            const completion = document.getElementById('completion').value;\n\n            if (prompt && completion) {\n                data[selectedIndex] = { prompt, completion };\n                updateJsonlPreview();\n            }\n        }\n    }\n\n    function deleteLastLine() {\n        data.pop();\n        updateJsonlPreview();\n    }\n\n    function updateJsonlPreview() {\n        const jsonlPreview = document.getElementById('jsonlPreview');\n        jsonlPreview.value = data.map(entry => JSON.stringify(entry)).join('\\n');\n    }\n\n    function downloadJson() {\n        const jsonData = data.map(entry => JSON.stringify(entry)).join('\\n');\n        const blob = new Blob([jsonData], { type: 'application\/jsonl' });\n        const url = URL.createObjectURL(blob);\n        const a = document.createElement('a');\n        a.href = url;\n        a.download = 'data.jsonl';\n        a.click();\n    }\n\n    function exportToCsv() {\n        const csvContent = data.map(entry => `\"${entry.prompt}\",\"${entry.completion}\"`).join('\\n');\n        const blob = new Blob([csvContent], { type: 'text\/csv' });\n        const url = URL.createObjectURL(blob);\n        const a = document.createElement('a');\n        a.href = url;\n        a.download = 'data.csv';\n        a.click();\n    }\n\n    function searchJson() {\n        const searchText = document.getElementById('search').value.toLowerCase();\n        const filteredData = data.filter(entry => entry.prompt.toLowerCase().includes(searchText) || entry.completion.toLowerCase().includes(searchText));\n\n        const jsonlPreview = document.getElementById('jsonlPreview');\n        jsonlPreview.value = filteredData.map(entry => JSON.stringify(entry)).join('\\n');\n    }\n\n}\n\nwindow.onload = initialize;\n<\/script>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-e06c6fc elementor-widget elementor-widget-heading\" data-id=\"e06c6fc\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h1 class=\"elementor-heading-title elementor-size-default\">JSONL Converter: Easily Convert CSV to JSONL and Vice Versa<\/h1>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b54e6df elementor-widget elementor-widget-heading\" data-id=\"b54e6df\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h1 class=\"elementor-heading-title elementor-size-default\">OLD VERSION. for GPT3<\/h1>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-cbd0783 elementor-widget elementor-widget-text-editor\" data-id=\"cbd0783\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>JSONL, short for JSON Lines, is a format used for storing structured data, where each line is a valid JSON object. JSONL is used when dealing with large datasets, as it is more memory-efficient and allows for easy streaming of data. However, working with JSONL files can be challenging, especially if you are not familiar with the format. That&#8217;s why we&#8217;ve created the JSONL Converter, a free online tool that makes it easy to convert CSV files to JSONL and vice versa.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ad14219 elementor-widget elementor-widget-html\" data-id=\"ad14219\" data-element_type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<!DOCTYPE html>\n<html lang=\"en\">\n<head>\n    <meta charset=\"UTF-8\">\n    <meta name=\"viewport\" content=\"width=device-width, initial-scale=1.0\">\n \n \n<\/head>\n<body>\n    <div class=\"container\">\n        \n        <div>\n            <label for=\"importFile\">Import CSV\/TSV:<\/label>\n            <input type=\"file\" id=\"importFile\">\n        <\/div>\n        <div>\n            <label for=\"prompt\">Prompt:<\/label>\n            <textarea id=\"prompt\" rows=\"2\"><\/textarea>\n        <\/div>\n        <div>\n            <label for=\"completion\">Completion:<\/label>\n            <textarea id=\"completion\" rows=\"2\"><\/textarea>\n        <\/div>\n        <button id=\"addBtn\">Add Prompt & Completion to JSONL<\/button>\n        <button id=\"updateBtn\">Update Selected Entry<\/button>\n        <button id=\"deleteBtn\">Delete Last Line<\/button>\n    \n        <h2>JSONL File Preview:<\/h2>\n        <input type=\"text\" id=\"search\" placeholder=\"Search...\">\n        <textarea id=\"jsonlPreview\" readonly rows=\"10\"><\/textarea>\n      <button id=\"formatUploadBtn\">Format for Upload<\/button>\n       <button id=\"downloadBtn\">Download JSON<\/button>\n        <button id=\"exportBtn\">Export to CSV<\/button>\n\n    <\/div>\n    <script src=\"https:\/\/promptmuse.com\/wp-content\/uploads\/custom-css-js\/2447.js\"><\/script>\n  \n<\/body>\n<\/html>\n <script>\n     document.addEventListener(\"DOMContentLoaded\", function () {\n  document.getElementById('importFile').addEventListener('change', handleFileSelect, false);\n  document.getElementById('addBtn').addEventListener('click', addEntry);\n  document.getElementById('updateBtn').addEventListener('click', updateEntry);\n  document.getElementById('deleteBtn').addEventListener('click', deleteLastLine);\n  document.getElementById('downloadBtn').addEventListener('click', downloadJson);\n  document.getElementById('exportBtn').addEventListener('click', exportToCsv);\n  document.getElementById('search').addEventListener('input', searchJson);\n  document.getElementById('formatUploadBtn').addEventListener('click', formatForUpload);\n\n  let data = [];\n  let selectedIndex = -1;\n\n  function formatForUpload() {\n    data = data.map(entry => {\n      const hasPromptSuffix = entry.prompt.endsWith(\" ###\");\n      const hasCompletionPrefix = entry.completion.startsWith(\" \");\n      const hasCompletionSuffix = entry.completion.endsWith(\" END\");\n\n      return {\n        prompt: hasPromptSuffix ? entry.prompt : entry.prompt + \" ###\",\n        completion: (hasCompletionPrefix ? \"\" : \" \") + entry.completion + (hasCompletionSuffix ? \"\" : \" END\")\n      };\n    });\n    updateJsonlPreview();\n  }\n\n  function handleFileSelect(evt) {\n    const file = evt.target.files[0];\n    const reader = new FileReader();\n\n    reader.onload = (event) => {\n      const fileContent = event.target.result;\n      const lines = fileContent.split('\\n');\n      const headers = lines[0].split(',').map(header => header.trim().toLowerCase());\n\n      const promptIndex = headers.indexOf('prompt');\n      const completionIndex = headers.indexOf('completion');\n\n      if (promptIndex === -1 || completionIndex === -1) {\n        alert('Invalid CSV file. Please make sure it contains the \"PROMPT\" and \"COMPLETION\" columns.');\n        return;\n      }\n\n      for (let i = 1; i < lines.length; i++) {\n        const line = lines[i];\n        if (line) {\n          const values = line.split(',');\n          const entry = {\n            prompt: values[promptIndex].replace(\/['\"]+\/g, ''),\n            completion: values[completionIndex].replace(\/['\"]+\/g, '')\n          };\n          data.push(entry);\n        }\n      }\n      updateJsonlPreview();\n    };\n    reader.readAsText(file);\n  }\n\n  function addEntry() {\n    const prompt = document.getElementById('prompt').value;\n    const completion = document.getElementById('completion').value;\n\n    if (prompt && completion) {\n      const newEntry = { prompt, completion };\n\n      if (isDuplicateEntry(newEntry)) {\n        alert('This entry is a duplicate and cannot be added.');\n      } else {\n        data.push(newEntry);\n        updateJsonlPreview();\n      }\n    }\n  }\n\n  function isDuplicateEntry(newEntry) {\n    return data.some(entry => entry.prompt === newEntry.prompt && entry.completion === newEntry.completion);\n  }\n\n  function updateJsonlPreview() {\n    const jsonlPreview = document.getElementById('jsonlPreview');\n    jsonlPreview.value = data.map(entry => JSON.stringify(entry)).join('\\n');\n    jsonlPreview.addEventListener('click', selectLine);\n  }\n\n  function selectLine() {\n    const jsonlPreview = document.getElementById('jsonlPreview');\n    const cursorPosition = jsonlPreview.selectionStart;\n    let start = cursorPosition;\n    let end = cursorPosition;\n\n    while (start > 0 && jsonlPreview.value[start - 1\n\n <\/script>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3e00cc6 elementor-align-center elementor-widget elementor-widget-button\" data-id=\"3e00cc6\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/promptmuse.com\/free-openai-fine-tuner\/\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t\t\t\t<span class=\"elementor-button-text\">GOTO FINE TUNER \/ UPLOADER<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-0e665af elementor-widget elementor-widget-text-editor\" data-id=\"0e665af\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<h2>How to Use the JSONL Converter<\/h2><p>The JSONL Converter is a simple tool that allows you to import CSV files, edit, format, and export them as JSONL files. To get started, follow these steps:<\/p><ol><li><h3>Import your CSV file &#8211; (optional)<\/h3><\/li><\/ol><p>To import your CSV file, click on the &#8220;Choose File&#8221; button, select your file, and click &#8220;Open.&#8221; Once you have uploaded your file, the tool will automatically convert it to JSONL format and display it in the preview area.<\/p><ol start=\"2\"><li><h3>Add or Edit Entries<\/h3><\/li><\/ol><p>To add or edit entries, simply enter the data in the &#8220;Prompt&#8221; and &#8220;Completion&#8221; fields, and click on the &#8220;Add&#8221; or &#8220;Update&#8221; buttons, respectively. You can edit any entry by selecting it from the preview area, making changes, and clicking the &#8220;Update&#8221; button.<\/p><ol start=\"3\"><li><h3>Format Data for Upload<\/h3><\/li><\/ol><p>If you plan to use your data for machine learning, you need to format it correctly. The JSONL Converter has a built-in feature that formats the data to ensure that it works correctly with machine learning models. To format the data for upload, click the &#8220;Format for Upload&#8221; button.<\/p><ol start=\"4\"><li><h3>Download your JSONL or CSV file<\/h3><\/li><\/ol><p>Once you have made all the changes you need, you can download your file as a JSONL or CSV file. To do this, click on the &#8220;Download JSON&#8221; or &#8220;Export CSV&#8221; button.<\/p><h2>Features of the JSONL Converter<\/h2><ol><li><h3>Import CSV files easily<\/h3><\/li><\/ol><p>The JSONL Converter allows you to import CSV files easily. The tool automatically detects the columns and rows and converts them to JSONL format.<\/p><ol start=\"2\"><li><h3>Add, edit, and delete entries<\/h3><\/li><\/ol><p>The tool allows you to add, edit, and delete entries with ease. You can select an entry from the preview area, edit it, and click the &#8220;Update&#8221; button to save your changes.<\/p><ol start=\"3\"><li><h3>Format data for machine learning models<\/h3><\/li><\/ol><p>The JSONL Converter has a built-in feature that formats the data to ensure that it works correctly with machine learning models. This feature adds special characters to the end and beginning of each prompt and completion to help the models understand the data better.<\/p><ol start=\"4\"><li>Download JSONL or CSV files<\/li><\/ol><p>Once you have made all the changes you need, you can download your file as a JSONL or CSV file. This feature allows you to use your data in other applications easily.<\/p><ol start=\"5\"><li><h3>Search through the data<\/h3><\/li><\/ol><p>The tool allows you to search through your data easily. The search feature allows you to filter your data based on a search term.<\/p><p>If you work with structured data, you know how important it is to have the right tools. The JSONL Converter is a free online tool that allows you to convert CSV files to JSONL and vice versa easily. The tool also allows you to edit, format, and download your data quickly. Whether you are a data scientist, a machine learning engineer, or a software developer, the JSONL Converter is an essential tool to have in your toolbox.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>JSONL Converter: Easily Convert CSV to JSONL and Vice Versa OLD VERSION. for GPT3 JSONL, short for JSON Lines, is a format used for storing structured data, where each line is a valid JSON object. JSONL is used when dealing with large datasets, as it is more memory-efficient and allows for easy streaming of data.<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-templates\/no-wrapper.php","meta":{"_acf_changed":false,"footnotes":""},"acf":[],"ams_acf":[],"_links":{"self":[{"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/pages\/3114"}],"collection":[{"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/comments?post=3114"}],"version-history":[{"count":0,"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/pages\/3114\/revisions"}],"wp:attachment":[{"href":"https:\/\/promptmuse.com\/wp-json\/wp\/v2\/media?parent=3114"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}