use https for features.
text: sort by
tags: modified
type: chronology
{555} is owned by tlh24 ryohei.{561} is owned by tlh24 ryohei.{548} is owned by tlh24 ryohei.{569} is owned by tlh24 ryohei.{547} is owned by tlh24 ryohei.{560} is owned by tlh24 ryohei.{564} is owned by tlh24 ryohei.{562} is owned by tlh24 ryohei.{563} is owned by tlh24 ryohei.{556} is owned by tlh24 ryohei.
hide / / print
ref: -2017 tags: neuromorphic optical computing nanophotonics date: 06-17-2019 14:46 gmt revision:5 [4] [3] [2] [1] [0] [head]

Progress in neuromorphic photonics

  • Similar idea as what I had -- use lasers as the optical nonlinearity.
    • They add to this the idea of WDM and 'MRR' (micro-ring resonator) weight bank -- they don't talk about the ability to change the weihts, just specify them with some precision.
  • Definitely makes the case that III-V semiconductor integrated photonic systems have the capability, in MMACs/mm^2/pj, to exceed silicon.

See also :

hide / / print
ref: -0 tags: nanophotonics interferometry neural network mach zehnder interferometer optics date: 06-13-2019 21:55 gmt revision:3 [2] [1] [0] [head]

Deep Learning with Coherent Nanophotonic Circuits

  • Used a series of Mach-Zehnder interferometers with thermoelectric phase-shift elements to realize the unitary component of individual layer weight-matrix computation.
    • Weight matrix was decomposed via SVD into UV*, which formed the unitary matrix (4x4, Special unitary 4 group, SU(4)), as well as Σ\Sigma diagonal matrix via amplitude modulators. See figure above / original paper.
    • Note that interfereometric matrix multiplication can (theoretically) be zero energy with an optical system (modulo loss).
      • In practice, you need to run the phase-moduator heaters.
  • Nonlinearity was implemented electronically after the photodetector (e.g. they had only one photonic circuit; to get multiple layers, fed activations repeatedly through it. This was a demonstration!)
  • Fed network FFT'd / banded recordings of consonants through the network to get near-simulated vowel recognition.
    • Claim that noise was from imperfect phase setting in the MZI + lower resolution photodiode read-out.
  • They note that the network can more easily (??) be trained via the finite difference algorithm (e.g. test out an incremental change per weight / parameter) since running the network forward is so (relatively) low-energy and fast.
    • Well, that's not totally true -- you need to update multiple weights at once in a large / deep network to descend any high-dimensional valleys.

hide / / print
ref: -0 tags: synaptic plasticity 2-photon imaging inhibition excitation spines dendrites synapses 2p date: 05-31-2019 23:02 gmt revision:2 [1] [0] [head]

PMID-22542188 Clustered dynamics of inhibitory synapses and dendritic spines in the adult neocortex.

  • Cre-recombinase-dependent labeling of postsynapitc scaffolding via Gephryn-Teal fluorophore fusion.
  • Also added Cre-eYFP to lavel the neurons
  • Electroporated in utero e16 mice.
    • Low concentration of Cre, high concentrations of Gephryn-Teal and Cre-eYFP constructs to attain sparse labeling.
  • Located the same dendrite imaged in-vivo in fixed tissue - !! - using serial-section electron microscopy.
  • 2230 dendritic spines and 1211 inhibitory synapses from 83 dendritic segments in 14 cells of 6 animals.
  • Some spines had inhibitory synapses on them -- 0.7 / 10um, vs 4.4 / 10um dendrite for excitatory spines. ~ 1.7 inhibitory
  • Suggest that the data support the idea that inhibitory inputs maybe gating excitation.
  • Furthermore, co-inervated spines are stable, both during mormal experience and during monocular deprivation.
  • Monocular deprivation induces a pronounced loss of inhibitory synapses in binocular cortex.

hide / / print
ref: -0 tags: 3D SHOT Alan Hillel Waller 2p photon holography date: 05-31-2019 22:19 gmt revision:4 [3] [2] [1] [0] [head]

PMID-29089483 Three-dimensional scanless holographic optogenetics with temporal focusing (3D-SHOT).

  • Pégard NC1,2, Mardinly AR1, Oldenburg IA1, Sridharan S1, Waller L2, Adesnik H3,4
  • Combines computer-generated holography and temporal focusing for single-shot (no scanning) two-photon photo-activation of opsins.
  • The beam intensity profile determines the dimensions of the custom temporal focusing pattern (CTFP), while phase, a previously unused degree of freedom, is engineered to make 3D holograph and temporal focusing compatible.
  • "To ensure good diffraction efficiency of all spectral components by the SLM, we used a lens Lc to apply a small spherical phase pattern. The focal length was adjusted so that each spectral component of the pulse spans across the short axis of the SLM in the Fourier domain".
    • That is, they spatially and temporally defocus the pulse to better fill the SLM. The short axis of the SLM in this case is Y, per supplementary figure 2.
  • The image of the diffraction grating determines the plane of temporal focusing (with lenses L1 and L2); there is a secondary geometric focus due to Lc behind the temporal plane, which serves as an aberration.
  • The diffraction grating causes the temporal pattern to scan to produce a semi-spherical stimulated area ('disc').
  • Rather than creating a custom 3D holographic shape for each neuron, the SLM is after the diffraction grating -- it imposes phase and space modulation to the CTFP, effectively convolving it with a holograph of a cloud of points & hence replicating at each point.

hide / / print
ref: -0 tags: Na Ji 2p two photon fluorescent imaging pulse splitting damage bleaching date: 05-31-2019 19:55 gmt revision:5 [4] [3] [2] [1] [0] [head]

PMID-18204458 High-speed, low-photodamage nonlinear imaging using passive pulse splitters

  • Core idea: take a single pulse and spread it out to N=2 kN= 2^k pulses using reflections and delay lines.
  • Assume two optical processes, signal SI αS \propto I^{\alpha} and photobleaching/damage DI βD \propto I^{\beta} , β>α>1\beta \gt \alpha \gt 1
  • Then an NN pulse splitter requires N 11/αN^{1-1/\alpha} greater average power but reduces the damage by N 1β/α.N^{1-\beta/\alpha}.
  • At constant signal, the same NN pulse splitter requires N\sqrt{N} more power, consistent with two photon excitation (proportional to the square of the intensity: N pulses of N/N\sqrt{N}/N intensity, 1/N per pulse fluorescence, Σ1\Sigma \rightarrow 1 overall fluorescence.)
  • This allows for shorter dwell times, higher power at the sample, lower damage, slower photobleaching, and better SNR for fluorescently labeled slices.
  • Examine the list of references too, e.g. "Multiphoton multifocal microscopy exploiting a diffractive optical element" (2003)

hide / / print
ref: -2019 tags: three photon imaging visual cortex THG chirp NOPA mice GCaMP6 MIT date: 03-01-2019 18:46 gmt revision:2 [1] [0] [head]

PMID-30635577 Functional imaging of visual cortical layers and subplate in awake mice with optimized three photon microscopy

  • Murat Yildirim, Hiroki Sugihara, Peter T.C. So & Mriganka Sur'
  • Used a fs Ti:Saphirre 16W pump into a non-colinear optical parametric amplifier (both from Spectra-Physics) to generate the 1300nm light.
  • Used pulse compensation to get the pulse width at the output of the objective to 40 fS.
    • Three-photon cross section is inverse quadratic in pulse width:
    • NP 3δ(τR) 2(NA 22hcλ) 3 N \sim \frac{P^3 \delta}{(\tau R)^2} (\frac{NA^2}{2hc\lambda})^3
    • P is power, δ\delta is 3p cross-section, τ\tau is pulse width, R repetition rate, NA is the numerical aperture (sixth power of NA!!!), h c and λ\lambda Planks constant, speed of light, and wavelength respectively.
  • Optimized excitation per depth by monitoring damage levels. varied from 0.5nJ to 5 nJ.
  • Imaged up to 1.5mm deep! All the way to the white matter / subplate.
  • Allegedly used a custom scan and tube lens to minimize aberrations in the excitation path (hence improve 3p excitation)
  • Layer 5 neurons are more broadly tuned for orientation than other layers. But the data is not dramatic.
  • Used straightforward metrics for tuning, using a positive and negative bump gaussian fit, then vector averaging to get global orientation selectivity.
  • Interesting that the variance between layers seems higher than between mice.

hide / / print
ref: -0 tags: optical neural recording photon induced electron transfer date: 01-02-2013 04:25 gmt revision:2 [1] [0] [head]

PMID-22308458 Optically monitoring voltage in neurons by photo-induced electron transfer through molecular wires.

  • Photoinduced electron transfer.
    • About what you would think -- a photon bumps an electron into a higher orbital, and this electron can be donated to another group or drop back down & fluoresce a photon.
  • Good sensitivity: ΔF/F\Delta F/F of 20-27% per 100mV, fast kinetics.
  • Not presently genetically targetable.
  • Makes sense in terms of energy: "A 100-mV depolarization changes the PeT driving force by 0.05 eV (one electron × half of 100-mV potential, or 0.05 V). Because PeT is a thermally controlled process, the value of 0.05 eV is large relative to the value of kT at 300 K (0.026 eV), yielding a large dynamic range between the rates of PeT at resting and depolarized potentials.
  • Why electrochromic dyes have plateaued:
    • "In contrast, electrochromic dyes have smaller delta G values, 0.003 (46) to 0.02 (47) eV, and larger comparison energies. Because the interaction is a photochemically controlled process, the energy of the exciting photon is the comparison energy, which is 1.5–2 eV for dyes in the blue-to-green region of the spectrum. Therefore, PeT and FRET dyes have large changes in energy versus their comparison energy (0.05 eV vs. 0.026 eV), giving high sensitivities; electrochromic dyes have small changes compared with the excitation photon (0.003–0.02 eV vs. 2 eV), producing low voltage sensitivity."

hide / / print
ref: Grutzendler-2011.09 tags: two-photon imaging in-vivo neurons recording dendrites spines date: 01-03-2012 01:02 gmt revision:3 [2] [1] [0] [head]

PMID-21880826[0] http://cshprotocols.cshlp.org/content/2011/9/pdb.prot065474.full?rss=1

  • Excellent source of information and references. Go CSH!
  • Possible to image up to 400um deep. PMID-12490949[1]
  • People have used TPLSM imaging for years in mice. PMID-19946265[2]


[0] Grutzendler J, Yang G, Pan F, Parkhurst CN, Gan WB, Transcranial two-photon imaging of the living mouse brain.Cold Spring Harb Protoc 2011:9, no Pages (2011 Sep 1)
[1] Grutzendler J, Kasthuri N, Gan WB, Long-term dendritic spine stability in the adult cortex.Nature 420:6917, 812-6 (2002 Dec 19-26)
[2] Yang G, Pan F, Gan WB, Stably maintained dendritic spines are associated with lifelong memories.Nature 462:7275, 920-4 (2009 Dec 17)

hide / / print
ref: notes-0 tags: two-photon laser imaging fluorescence lifetime imaging FRET GFP RFP date: 01-21-2008 17:23 gmt revision:0 [head]