TechSupport
TechSupport
PostsComments
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
No description
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
So I tried some of your suggestions, but I think because of lack of knowledge of workers, clusters and puppeteer in general it's hard and tedious for me to actually understand what's going on. My idea is for users to scrape information of their preference so it will run 24/7. And then they can use commands like /add URL to scrape (i know myself what to scrape). and they can do /list to see what URLS they are scraping or /remove INDEX from list. To scrape ill be using a Ubuntu server per user with 2 cores so every person has their own enviroment so they all run at the same speed (it'll be subscription based bot). I have made this exact script in Python before, loading 1 URL at a time and it works. It's just really slow and not user friendly when using commands etc. I have been trying things out with clusters and workers, but I can't seem to get the hang of it. Yeah it's working sort of, but I get rate limited after 25 times. And to fix that I just restart the script and poof ratelimits are gone, it's really weird in my opinion. Right now I am debating which good and which is bad (efficiency wise). I hope you can help me
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
Thanks for all this information. I will look at it Monday, because I'm going to defqon 1 soon. I scrape 5 URLs with 10 different parameters (50 Unique URLs). They only required to load the whole page using a wait for networkidle0. After this it fills in an input field and click on a button. After it's done that it will go thru a container in multiple ShadowDOMS looking for the right items to scrape using .filter. After it's done that it will go to the next URL until it's done for the 1 URL and 10 parameters and then it will sent all info
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
So I'm trying to fix that first on my end
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
But I got ratelimited real fast
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
I tried to use clusters
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
How would I have to do it with JS though
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
Is there anyone able to help with this though?
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
when using it parallel yeah
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
I scrape them one by one, when I asked explain what worked threads are in Chat-GPT. They responded that it boosts performance when using multiple URL's
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
Okay and it also boosts performance when scraping multiple URL's that's nice, because I need to scrape like 50-100 URL's
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
what's a "worker thread"
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
and it was so not user friendly.
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 6/24/2024 in #djs-questions
Running commands asynchronously
when I was making this in Python I checked if there was any messages sent in a specific channel the past few seconds and if there was it checked the message and from that it ran a function
33 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 3/14/2024 in #djs-questions
Discord Embed not sending
nevermind
10 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 3/14/2024 in #djs-questions
Discord Embed not sending
oh wait
10 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 3/14/2024 in #djs-questions
Discord Embed not sending
and where do i fill in the channel id?
10 replies
DIAdiscord.js - Imagine an app
Created by TechSupport on 3/14/2024 in #djs-questions
Discord Embed not sending
Error 
DiscordAPIError[50006]: Cannot send an empty message
    at handleErrors (C:\Users\maike\node_modules\@discordjs\rest\dist\index.js:722:13)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async SequentialHandler.runRequest (C:\Users\maike\node_modules\@discordjs\rest\dist\index.js:1120:23)
    at async SequentialHandler.queueRequest (C:\Users\maike\node_modules\@discordjs\rest\dist\index.js:953:14)
    at async _REST.request (C:\Users\maike\node_modules\@discordjs\rest\dist\index.js:1266:22)    
    at async TextChannel.send (C:\Users\maike\node_modules\discord.js\src\structures\interfaces\TextBasedChannel.js:155:15)
    at async checkForUpdates (file:///C:/Users/maike/OneDrive/Documenten/Bureaublad/Python/Crypto/puppeteer-real-browser/src/walletTracker.js:124:9) {
  requestBody: {
    files: [],
    json: {
      content: undefined,
      tts: false,
      nonce: undefined,
      embeds: undefined,
      components: undefined,
      username: undefined,
      avatar_url: undefined,
      allowed_mentions: undefined,
      flags: undefined,
      message_reference: undefined,
      attachments: undefined,
      sticker_ids: undefined,
      thread_name: undefined
    }
  },
  rawError: { message: 'Cannot send an empty message', code: 50006 },
  code: 50006,
  status: 400,
  method: 'POST',
  url: 'https://discord.com/api/v10/channels/1217259060227866664/messages'
}
DiscordAPIError[50006]: Cannot send an empty message
    at handleErrors (C:\Users\maike\node_modules\@discordjs\rest\dist\index.js:722:13)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async SequentialHandler.runRequest (C:\Users\maike\node_modules\@discordjs\rest\dist\index.js:1120:23)
    at async SequentialHandler.queueRequest (C:\Users\maike\node_modules\@discordjs\rest\dist\index.js:953:14)
    at async _REST.request (C:\Users\maike\node_modules\@discordjs\rest\dist\index.js:1266:22)    
    at async TextChannel.send (C:\Users\maike\node_modules\discord.js\src\structures\interfaces\TextBasedChannel.js:155:15)
    at async checkForUpdates (file:///C:/Users/maike/OneDrive/Documenten/Bureaublad/Python/Crypto/puppeteer-real-browser/src/walletTracker.js:124:9) {
  requestBody: {
    files: [],
    json: {
      content: undefined,
      tts: false,
      nonce: undefined,
      embeds: undefined,
      components: undefined,
      username: undefined,
      avatar_url: undefined,
      allowed_mentions: undefined,
      flags: undefined,
      message_reference: undefined,
      attachments: undefined,
      sticker_ids: undefined,
      thread_name: undefined
    }
  },
  rawError: { message: 'Cannot send an empty message', code: 50006 },
  code: 50006,
  status: 400,
  method: 'POST',
  url: 'https://discord.com/api/v10/channels/1217259060227866664/messages'
}
10 replies