Possibility to export discussions ?

[hugtalbot]

Is the feature for an export from GitHub discussions towards other solutions will be provided in the API?

[PranamBhat]

Hi @hugtalbot

This feature is not available at the moment.

Thank you!

[PranamBhat]

Hi @hugtalbot

No. It was not there. I have cross verified.

However I found these links. You can try something like (Issues)this at this stage:

https://stackoverflow.com/questions/41369365/how-can-i-export-github-issues-to-excel

https://github.blog/2018-12-19-download-your-data/

[johnandersen777]

Can we please add this? I converted an issue thread to a discussion and didn't realize I was loosing my ability to export it....

[cbarillari]

Is the export available now by any chance?

[aliceoa]

Hacked up version here (from Alice discussion dump work):

• Initial: https://github.com/intel/dffml/blob/alice/docs/arch/alice/discussion/0023/reply_0051.md
• Evolved with dump to individual files: https://github.com/intel/dffml/blob/alice/scripts/dump_discussion.py
  • Example: https://github.com/intel/dffml/tree/alice/docs/arch/alice/discussion

[johnandersen777]

• https://github.com/intel/dffml/blob/main/scripts/discussion_dump_to_markdown.py

Graphql json dump:

"""
Usage
*****

.. code-block:: console

    $ python -u scripts/dump_discussion.py --token $(gh auth token) --owner $(git remote get-url upstream | sed -e 's/.*github.com\///g' | sed -e 's/\/.*//g') --repo $(git remote get-url upstream | sed -e 's/\/$//g' -e 's/.*\///g') --discussion-number 1406 | tee 1406.json
"""
import os
import asyncio
import aiohttp
import json
from dataclasses import dataclass
from typing import List
import argparse

@dataclass
class Reply:
    body: str

@dataclass
class Comment:
    body: str
    replies: List[Reply]

@dataclass
class Discussion:
    body: str
    title: str
    comments: List[Comment]

async def fetch_discussion_data(session, token, owner, repo, discussion_number):
    headers = {
        "Authorization": f"Bearer {token}",
        "Content-Type": "application/json"
    }

    query = """
    query($owner: String!, $repo: String!, $discussionNumber: Int!, $commentsCursor: String, $repliesCursor: String) {
      repository(owner: $owner, name: $repo) {
        discussion(number: $discussionNumber) {
          title
          body
          comments(first: 100, after: $commentsCursor) {
            pageInfo {
              hasNextPage
              endCursor
            }
            nodes {
              body
              replies(first: 100, after: $repliesCursor) {
                pageInfo {
                  hasNextPage
                  endCursor
                }
                nodes {
                  body
                }
              }
            }
          }
        }
      }
    }
    """

    variables = {
        "owner": owner,
        "repo": repo,
        "discussionNumber": discussion_number
    }

    discussion_data = []
    has_next_page = True
    comments_cursor = None

    while has_next_page:
        variables["commentsCursor"] = comments_cursor
        response = await session.post("https://api.github.com/graphql", headers=headers, json={"query": query, "variables": variables})
        result = await response.json()

        discussion_title = result["data"]["repository"]["discussion"]["title"]
        discussion_body = result["data"]["repository"]["discussion"]["body"]
        comments = result["data"]["repository"]["discussion"]["comments"]["nodes"]
        has_next_page = result["data"]["repository"]["discussion"]["comments"]["pageInfo"]["hasNextPage"]
        comments_cursor = result["data"]["repository"]["discussion"]["comments"]["pageInfo"]["endCursor"]

        for comment in comments:
            comment_body = comment["body"]
            replies = []

            has_next_reply_page = True
            replies_cursor = None

            while has_next_reply_page:
                variables["repliesCursor"] = replies_cursor
                response = await session.post("https://api.github.com/graphql", headers=headers, json={"query": query, "variables": variables})
                reply_result = await response.json()

                reply_nodes = comment["replies"]["nodes"]
                has_next_reply_page = comment["replies"]["pageInfo"]["hasNextPage"]
                replies_cursor = comment["replies"]["pageInfo"]["endCursor"]

                for reply in reply_nodes:
                    replies.append(Reply(body=reply["body"]))

            discussion_data.append(Comment(body=comment_body, replies=replies))

    return Discussion(title=discussion_title, body=discussion_body, comments=discussion_data)

async def main():
    parser = argparse.ArgumentParser(description="Fetch GitHub discussion data")
    parser.add_argument("--token", help="GitHub Access Token")
    parser.add_argument("--owner", help="GitHub Repository Owner")
    parser.add_argument("--repo", help="GitHub Repository Name")
    parser.add_argument("--discussion-number", type=int, help="GitHub Discussion Number")
    args = parser.parse_args()

    async with aiohttp.ClientSession(trust_env=True) as session:
        discussion_data = await fetch_discussion_data(session, args.token, args.owner, args.repo, args.discussion_number)
        print(json.dumps(discussion_data, default=lambda x: x.__dict__, indent=2))

if __name__ == "__main__":
    asyncio.run(main())

[LeaVerou]

IANAL but isn't it a violation of GDPR to not provide an export option?

[jmikedupont2]

can we get an event trigger on new mesages via the api? can we get json for the disussion via graphql

[jmikedupont2]

here are soutions
https://github.com/shridhar-tl/github-2-markdown
and
https://github.com/King-of-Infinite-Space/gh-discussions-export
and my latest simple python graphql here https://github.com/jmikedupont2/meta-meme/blob/dc61ba23d9717155a7d68505abef910bffe75ff8/examples/generator/pull_git_comments.py (edited to add in missing link)

[shenweiyan]

here are soutions https://github.com/shridhar-tl/github-2-markdown and https://github.com/King-of-Infinite-Space/gh-discussions-export and my latest simple python graphql here

It seems that I haven't seen any programs for Python GraphQL.

[jmikedupont2]

sorry here is the code I wrote https://github.com/jmikedupont2/meta-meme/blob/dc61ba23d9717155a7d68505abef910bffe75ff8/examples/generator/pull_git_comments.py

[caco3]

Just a note:
If you want to export the first comment of each discussion, you can use this API: https://api.github.com/repos/owner/repo/discussions?per_page=100&page=1

And to get all further comments of a discussion use https://api.github.com/repos/owner/repo/discussions/Discussion-ID/comments

[untitaker]

Hi, I wrote a tool for this exact purpose and found this thread only afterwards. Here you go:

• https://codeberg.org/untitaker/github-discussions-mirror
• https://crates.io/crates/github-discussions-mirror

it can export/sync as JSON and convert the JSON to self-contained static HTML.