Commit Graph

196 Commits

Author SHA1 Message Date
Kaity A 706b4ae602 Add sonic full-text search support (#9714)
This pull request adds support for the [sonic](https://github.com/valeriansaliou/sonic) full text indexing server into Calckey.

In addition to this, a stateful endpoint has been added that will completely (re-)index all notes into any (elasticsearch and/or sonic) indexing server defined in your config at `/api/admin/search/index-all`. It can (optionally) take input data to define the starting point, such as:

```
{"cursor": "9beg3lx6ad"}
```

Currently if both sonic and elasticsearch are defined in the config, sonic will take precedence for searching, but both indexes will continue to be updated for new note creations. Future enhancements may include the ability to choose which indexer to use (or combine multiple).

Co-authored-by: Kaitlyn Allan <kaitlyn.allan@enlabs.cloud>
Reviewed-on: https://codeberg.org/calckey/calckey/pulls/9714
Co-authored-by: Kaity A <supakaity@noreply.codeberg.org>
Co-committed-by: Kaity A <supakaity@noreply.codeberg.org>
2023-03-19 08:26:47 +00:00
cutestnekoaqua 7a500ed836
chore: update megalodon 2023-03-18 11:52:18 +01:00
cutestnekoaqua 548381734a
some quick fixes 2023-03-01 15:04:01 +01:00
Cleo John 05acb51da2 more mastodon work 2023-02-28 17:23:04 +01:00
Masaya Suzuki ea5725b986
Check redis connection
---------

Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-02-23 22:04:47 -08:00
ThatOneCalculator 3e1048d3b1
chore: calckey megalodon 2023-02-11 16:20:57 -08:00
ThatOneCalculator 4ddb65410b
chore: up calckey.js 2023-02-11 13:04:22 -08:00
cutestnekoaqua 450c92f3e7
Revert "use formidable instead"
This reverts commit b8406ecaa4.
2023-02-11 00:19:52 +01:00
cutestnekoaqua b8406ecaa4
use formidable instead 2023-02-10 23:50:27 +01:00
cutestnekoaqua b197464638
Merge branch 'feature/masto-api' into develop 2023-02-10 00:13:20 +01:00
cutestnekoaqua 717aa899b1
feat: v1 Mastodon API
This commit adds (maybe unstable) support for Mastodons v1 api
also some v2 endpoints, maybe I miss stuff, I dont know.
We will need to test this but it should be kinda stable
and work like (old) butter.

Co-authored-by: Natty <natty.sh.git@gmail.com>
Co-authored-by: cutls <web-pro@cutls.com>
2023-02-09 23:21:50 +01:00
cutestnekoaqua c68c01a09e
wip masto api
co-authored-by: cutls <web-pro@cutls.com>
2023-02-07 22:56:39 +01:00
Asrael 44f593945c
build: reduce container size by removing dev dependencies from final image
This change moves many of the dependencies into devDependencies, by analyzing what is used in the runtime files. Additionally, NPM and apk cache are eliminated with multi-stage builds
2023-02-03 21:38:40 -08:00
CyberRex0 6282ccc614 Add android-arm64 binary for swc 2023-01-13 18:26:22 +00:00
ThatOneCalculator 67a9a36c27
close #9463 2023-01-12 20:58:43 -08:00
ThatOneCalculator 7c2dabd047
no more eslint 2023-01-12 20:54:33 -08:00
ThatOneCalculator 6b00abf05c
refactor: 🎨 rome 2023-01-12 20:40:33 -08:00
Kainoa Kanter f47832b1b4 refactor: 🔨 Use pnpm instead of yarn (#9461)
Reasons:

1. `pnpm` is now an industry standard, being faster and less buggy than `yarn`.
2. Faster build time as builds are concurrent: 63 seconds down to 35 seconds!!
3. Resolves #9412

Co-authored-by: ThatOneCalculator <kainoa@t1c.dev>
Reviewed-on: https://codeberg.org/calckey/calckey/pulls/9461
2023-01-13 04:18:16 +00:00
ThatOneCalculator 98401ff312
perf: 👷 build backend with swc
Co-authored-by: pikokr <@paring@pikokr.dev>
2023-01-10 16:48:49 -08:00
ThatOneCalculator db0dab012d
revert: koa/router 2023-01-10 14:14:40 -08:00
ThatOneCalculator ae98fe329b
chore: up pkgs 2023-01-03 15:43:52 -08:00
ThatOneCalculator 9921a391c0
Revert "chore: upgrade packages"
This reverts commit 245d3815c6.
2023-01-03 15:42:57 -08:00
ThatOneCalculator 245d3815c6
chore: upgrade packages 2023-01-03 15:12:38 -08:00
ThatOneCalculator c0cf1e2bf4
fixes 2023-01-03 09:12:26 -08:00
cutestnekoaqua 2025f4d68c
Reproducible Builds 2022-12-27 00:24:19 +01:00
ThatOneCalculator 78e6f38ef2
downgrade some packages 2022-12-18 11:13:24 -08:00
ThatOneCalculator d952912bff
feat: 📦 upgrade to vite 4 2022-12-18 11:03:08 -08:00
ThatOneCalculator 3a05623e87
fix calckeyjs 2022-12-12 10:19:18 -08:00
ThatOneCalculator 7509f9c502
fix ckjs 2022-12-12 10:04:57 -08:00
ThatOneCalculator 50cb7c6de1
Bug fixes, use calckey.js 2022-12-11 19:24:12 -08:00
ThatOneCalculator 1ee6a52a8a
final cleanup 2022-12-11 17:49:14 -08:00
cutestnekoaqua 91e39fa829 integrate migration ui and api backend 2022-12-12 01:54:44 +01:00
ThatOneCalculator 73e628ccb5 deprecate node < 18 2022-11-21 16:27:32 -08:00
ThatOneCalculator cf17d5feec upgrade deps 2022-11-18 17:20:34 -08:00
ThatOneCalculator cb6362fd49 chore: ⬆️ upgrade packages 2022-11-16 02:08:33 -08:00
ThatOneCalculator 3dd84a15d8 chore: ⬆️ update deps 2022-11-13 13:14:34 -08:00
ThatOneCalculator eaa4d17065 chore: 📦 package upgrades 2022-11-09 17:21:09 -08:00
Francis Dinh cd48673b2e backend: Update sharp to 0.31.2
This fixes a bug where the backend might crash when processing certain images on an ARM64 system.

See https://akkoma.dev/FoundKeyGang/FoundKey/issues/226 and https://github.com/misskey-dev/misskey/issues/8605 for details.
2022-11-08 19:52:08 +01:00
ThatOneCalculator 9cb1b1a48c update deps 2022-11-04 13:20:18 -07:00
ThatOneCalculator 471240b101 a 2022-11-04 13:12:56 -07:00
ThatOneCalculator e72348f5d1 OCR image captioning work 2022-10-27 15:01:38 -07:00
ThatOneCalculator d46f08c189 chore: 📦 Update packages 2022-10-27 14:25:31 -07:00
ThatOneCalculator a9eb58ac72 chore: 🔀 Merge upstream to 12.119.0 2022-09-10 12:13:55 -07:00
syuilo 7c89a27e61 update deps 2022-09-10 19:14:07 +09:00
ThatOneCalculator e8664b5664 chore: 🔀 Merge upstream 2022-09-09 12:16:58 -07:00
ThatOneCalculator 0f21d4c077 chore: ⬆️ Upgrade several deps
From yarn upgrade-interactive
2022-09-07 16:23:33 -07:00
Takuya Yoshida 057d1642c8
Update typeorm to 0.3.9 (#9083) 2022-09-06 14:57:46 +09:00
ThatOneCalculator 4dc706a91a chore: ⬆️ Upgrade TypeORM 2022-09-05 14:53:48 -07:00
ThatOneCalculator ab4c267594 Merge remote-tracking branch 'misskey/develop' into develop 2022-08-27 15:18:59 -07:00
syuilo 47b2e56967 update deps 2022-08-27 16:34:14 +09:00
ThatOneCalculator ea3c2441be fix: 🔒 Up multer to LTS as to avoid CVE-2022-24434 2022-08-17 15:57:16 -07:00
ThatOneCalculator c80577c709 Merge remote-tracking branch 'misskey/develop' into develop 2022-08-15 15:21:46 -07:00
syuilo dddc076d01 update deps 2022-08-13 18:45:29 +09:00
ThatOneCalculator 0e7361d4b8 Merge remote-tracking branch 'misskey/develop' into develop 2022-08-04 13:31:54 -07:00
syuilo 78f061b9db update deps 2022-07-31 22:01:01 +09:00
Johann150 d6a95797d8 remove ms dependency 2022-07-25 13:38:31 -07:00
ThatOneCalculator ee0a19c3f7 Merge remote-tracking branch 'misskey/develop' into develop 2022-07-25 10:23:27 -07:00
syuilo f835421d70 update deps 2022-07-25 21:10:06 +09:00
ThatOneCalculator 1f98b349bf Merge remote-tracking branch 'misskey/develop' into develop 2022-07-23 18:57:23 -07:00
dependabot[bot] ab9fcc863f
chore(deps): bump file-type from 17.1.2 to 17.1.3 in /packages/backend (#9030)
Bumps [file-type](https://github.com/sindresorhus/file-type) from 17.1.2 to 17.1.3.
- [Release notes](https://github.com/sindresorhus/file-type/releases)
- [Commits](https://github.com/sindresorhus/file-type/compare/v17.1.2...v17.1.3)

---
updated-dependencies:
- dependency-name: file-type
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-23 14:40:54 +09:00
syuilo 3acfeb1680 update tfjs 2022-07-23 14:31:15 +09:00
ThatOneCalculator f35d518caf oauth 2022-07-18 22:22:24 -07:00
ThatOneCalculator 0e25cf773a yarn lol 2022-07-18 22:04:21 -07:00
syuilo e30a03b5c4 update deps 2022-07-13 21:37:48 +09:00
nvisser 947f079735
Make tensorflow an optinal dependency (#8986) 2022-07-13 21:00:59 +09:00
syuilo 18206e3cf6 update mfm-js 0.23.0-canary.1 2022-07-10 21:09:37 +09:00
syuilo 49012f8352 update summaly 2022-07-09 18:23:21 +09:00
syuilo e560601815
feat: auto nsfw detection (#8840)
* feat: auto nsfw detection

* ✌️

* Update ja-JP.yml

* Update ja-JP.yml

* ポルノ判定のしきい値を高めに

* エラーハンドリングちゃんとした

* Update ja-JP.yml

* 感度設定を強化

* refactor

* feat: add video support for auto nsfw detection

* rename: image -> media

* .js

* fix: add missing error handling

* fix: use valid pathname instead of using filename due to invalid usage

* perf(nsfw-detection): decode frames

* disable detection of video for some reasons

* perf(nsfw-detection): streamify detection process for video

* disable disallowUploadWhenPredictedAsPorn option

* fix(nsfw-detection): improve reliability

* fix(nsfw-detection): use Math.ceil instead of Math.round

* perf(nsfw-detection): delete tmp frames after used

* fix(nsfw-detection): FSWatcher does not emit ready event

* perf(nsfw-detection): skip black frames

* refactor: strip exists check

* Update package.json

* めっちゃ変えた

* lint

* Update COPYING

* オプションで動画解析できるように

* Update yarn.lock

* Update CHANGELOG.md

Co-authored-by: Acid Chicken (硫酸鶏) <root@acid-chicken.com>
2022-07-07 21:06:37 +09:00
tamaina c81e5ae8f5 move resolutions 2022-07-05 05:17:37 +00:00
tamaina 9cd1526073 Merge branch 'develop' into pr/ThatOneCalculator/8764 2022-07-05 05:16:06 +00:00
syuilo 949dbb3918 feat(server): add fetch-rss api to reduce dependency of external apis 2022-07-02 21:26:33 +09:00
MeiMei 2f65d91ea8
migrate parse5 to 7.0.0 (#8916)
* migrate parse5 to 7.0.0

* fix
2022-07-01 13:48:03 +09:00
syuilo b846ebeb97 use parse5 6.0.1
Fix #8914
2022-07-01 11:07:14 +09:00
syuilo e3bf53ea84 update deps 2022-07-01 00:21:25 +09:00
tamaina b9154cda2f Merge branch 'develop' into pr/ThatOneCalculator/8764 2022-06-28 05:08:57 +00:00
dependabot[bot] 126011c1a7
chore(deps): bump jsrsasign from 10.5.24 to 10.5.25 in /packages/backend (#8889)
Bumps [jsrsasign](https://github.com/kjur/jsrsasign) from 10.5.24 to 10.5.25.
- [Release notes](https://github.com/kjur/jsrsasign/releases)
- [Changelog](https://github.com/kjur/jsrsasign/blob/master/ChangeLog.txt)
- [Commits](https://github.com/kjur/jsrsasign/compare/10.5.24...10.5.25)

---
updated-dependencies:
- dependency-name: jsrsasign
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-25 16:28:36 +09:00
MeiMei 6f8e3fe366
enhance: Redisをioredisに統一してIPv6サポート (#8869)
* Use ioredis, Supports IPv6 host

https://github.com/misskey-dev/misskey/issues/8862

* Fix import

* order

* a

* i

* fix

* flushdb

* family

* CHANGELOG

* redis_version

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2022-06-24 19:22:19 +09:00
MeiMei 6422cde5f2
enhance: Improve player detection in URL preview (#8849)
* enhance: Improve player detection in URL preview

* CHANGELOG
2022-06-18 16:02:31 +09:00
tamaina f2e593a35c remove packagemanager 2022-06-16 21:23:11 +09:00
tamaina 7ddfd049a4 Merge branch 'develop' into pr/ThatOneCalculator/8764 2022-06-16 21:19:17 +09:00
syuilo ec6b418a23 update deps 2022-06-10 15:06:42 +09:00
tamaina fba88e110a https://github.com/misskey-dev/misskey/pull/8764#discussion_r885749892 2022-06-04 23:34:23 +09:00
tamaina 09d1ba9f68 Merge branch 'develop' into pr/ThatOneCalculator/8764 2022-06-04 08:34:56 +00:00
syuilo abcd5bc951 update summaly 2022-06-04 17:24:41 +09:00
tamaina 41fadc9ae9 yarn node => node
依存関係の記載不足の解消がかなり多いため、yarn nodeは使わない
2022-06-04 08:07:27 +00:00
tamaina 1a837bbef4 wip 2022-06-04 08:01:02 +00:00
tamaina ac89f25b79 npm run => yarn 2022-06-03 22:39:07 +09:00
ThatOneCalculator db0344e6ca pnpm = dont change paths 2022-05-31 19:44:04 -07:00
ThatOneCalculator 3820a0722d package.json names 2022-05-31 19:41:15 -07:00
ThatOneCalculator 75d2336d8e 🙏 2022-05-31 00:13:41 -07:00
ThatOneCalculator a872e6e3bb :godmode: 2022-05-30 23:55:47 -07:00
ThatOneCalculator 71a907007c :goberserk: 2022-05-30 21:03:11 -07:00
ThatOneCalculator 95aff06dfc More yarn workspaces stuff 2022-05-30 17:31:24 -07:00
ThatOneCalculator dd1bfae823 fix the code that depends on node_modules 2022-05-29 22:19:40 -07:00
ThatOneCalculator 5c7fca456c Yarn berry 2022-05-29 12:40:08 -07:00
Johann150 9c80403072
use http-signature module that supports hs2019 (#8635) 2022-05-26 09:12:17 +09:00
syuilo b3ad04fcb0 update deps 2022-05-25 23:28:56 +09:00
MeiMei 6b44fe165b
Supports Unicode Emoji 14.0 (#8699)
* Unicode 14.0 Emoji

* mfm-js@0.22.0

* CHANGELOG

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2022-05-25 16:35:30 +09:00
MeiMei b6794b614b
enhance: Perform port diagnosis at startup only when Listen fails (#8698)
* Change port check

* Comment: disableClustering

* CHANGELOG

* Smart message
2022-05-19 11:49:07 +09:00
syuilo 6de40cf789 fix(server): prevent crash when processing certain PNGs
Fix #8605
2022-05-15 01:16:12 +09:00