Creative Destruction XYZ

Why are you participating for Based India?

The Why : 1)(Data and) Information in this space is fragmented across the entirety of the space, in small chunks and it tends to stay in there. There's absolutely no way right now to aggregate all of it in such a way that the end user is able to utilise it to its absolute limit or fullest extent (change this word here)

2)There's too much activity going on at a given point of time to keep up with. It can be especially difficult for people who have other obligations, who get overwhelmed by the sheer volume of activity. Its also very complicated to (follow) keep up with all the spaces you want to follow and stay on top of.

3. Information is divided up in various chunks across geographical and linguistic lines, and it makes it so that information which could've been usefull across the entirety of the space cannot be used by the others

Learning and sharing information within this space is extremely fragmented, we hope to make it much easier

Think of it as a supporting technology with the aim of transmission of learning from (and within) one community to another.

What challenges are you focusing on?

1)(Data and) Information in this space is fragmented across the entirety of the space, in small chunks and it tends to stay in there. There's absolutely no way right now to aggregate all of it in such a way that the end user is able to utilise it to its absolute limit or fullest extent (change this word here)

We offer prebuilt content aggregation pipelines

We solve this using our Data aggregation pipeline which funnels data from multiple platforms and websites (youtube, twitter, forums, discord, reddit, internet etc) so that we can (process it and use it later) use it to power our Unified Content Index

2)There's too much activity going on at a given point of time to keep up with. It can be especially difficult for people who have other obligations, who get overwhelmed by the sheer volume of activity. Its also very complicated to (follow) keep up with all the spaces you want to follow and stay on top of.

For this, we have a feature where people can receive a summary of the twitter space via email so they can keep updated ... or alternatively you can use our CMS system to access the data. Apart from this, we also support an event calendar tool which ties into your calendar and notifies you about spaces of your interest, when they happen and afterwards you can use it to access the data about said space.

3)There's significant loss of content which could've been useful to a wider audience but cannot due to geographical or linguistic or even across platforms lines which leads to the fragmentation of information which further hinders the process of data accumulation

To tackle this, we provide translations of the summary and the discussion itself in languages including but not limited to German, Spanish and Chinese. Anyone can access this data from the calendar itself or the upcoming web application (v1)

Anyone can access this data in a single click from their devices using the calendar app or the upcoming web application (v2)

How does your submission address this challenge?

We aggregate, archive, and process data, content (spaces, podcasts etc) and discussions from various platforms to create a searchable index, providing users with specific answers and sources through an automated, context-aware system. Along with Event / Spaces Coordination and access to the Content Management system which gives them access to the Transcripts, summaries, archive, Translations for the concluded and upcoming spaces. Click on the learn more button from our website for more info .

https://apecointracker.framer.website/

It'll aim to aggregate all the content, discussions, discourse and insights within an ecosystem and create a standalone Unified Content Index which could be integrated within a lot of tools. For which we have made custom solutions. Read about them here, in the use cases section : https://forum.apecoin.com/t/data-aggregation-pipeline-act-stack-v2-0/24643#use-cases-8

What we offer : • Event / Spaces Coordination and access to the Content Management system • Access to the Transcripts, summaries, archive, Translations for the concluded and upcoming spaces using the CMS • Summaries for Twitter Spaces / Shows / YT podcasts • Multilingual Translations for same • Unified Content Index (aggregating discussions across platforms to power a search engine) • An assistant (built using RAG) which you can tie into any platform (discord, twitter, etc) which can respond to your queries using the data we've aggregated

For how we do it : for this info, check out these resources Tweet aggregation pipeline -> https://forum.apecoin.com/t/tweet-aggregation-using-apecointracker-act-stack-v2-0/24651 Data aggregation funnel -> https://forum.apecoin.com/t/data-aggregation-pipeline-act-stack-v2-0/24643 Summary of the proposal -> https://docs.google.com/document/d/19X0eApZ2FdM072tChNOQpSlI_cURNHIXv2imlQ7l05M

Challenges we ran into

The custom search engine using redis was a pain to set up and get it up and running. But in the end I got it working, courtesy of a couple of 5-6 year old tutorials which were far outdated by now but discussed some specific concepts which helped me set this up .

Time management was a huge issue, as juggling studies with extra curriculars is hard

Also, juggling multiple hackathons, prepping for internals and then major exams for the 3rd sem was very tiresome. Participated in my college's 24 hour hackathon last friday (cybercup 4.0) and built a smart trafic management system which took real time feed from 4 yt live broadcasts of intersections I could find and then tracked their direction vector and only passed on vehicles moving within a certain range to the model to then determine the most optimal timings

Link to repo here : https://github.com/Dev-Anky07/cybercup4.0

Additional Features

The content Aggregation Pipeline was already built out beforehand :

Data Aggregation Pipeline : https://forum.apecoin.com/t/data-aggregation-pipeline-act-stack-v2-0/24643

Tweet aggregation Pipeline writeup : https://forum.apecoin.com/t/tweet-aggregation-using-apecointracker-act-stack-v2-0/24651

Tweet aggregation Pipeline in action : https://x.com/ThreatT0Society/status/1839373890377945178

Discord data agg pipeline in action : https://x.com/ThreatT0Society/status/1837928806931124659

Discord rag in action : https://x.com/ThreatT0Society/status/1838398315748004019